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(54) Method and device for messaging 

(57) in transmitting/receiving an E-mail with a file at- 
tached to it, the contents of the attached file is to be dis- 
played in a reception terminal irrespective of the file for- 
mat of a file attached to the E-mail, the image size or 
the maximum number of colors in displaying the file con- 
tents. To this end, the accommodating capability in a re- 
ception terminal is verified at step S12 based on a mail 
address in sending an E-mail with an attached file to a 
reception terminal at step S11 . If the accommodating ca- 
pability in the reception terminal is not matched to the 
attached file, the file is converted at steps S15, S17 in 
keeping with the accommodating capability of the recep- 
tion terminal, and the E-mail is sent at steps S16 and 
S18 to S20 with the so-converted file attached to it. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] This invention relates to information process- 
ing. 

Description of Related Art 

[0002] Recently, a so-called E-maii is frequently used 
as one of communication means. For a terminal for 
transmitting/receiving this E-mail, a general purpose 
computer, such as a so-called personal computer or a 
workstation, is used in a majority of cases. 
[0003] This genera! purpose computer is provided as 
a rule with a large-capacity hard disc. By using this 
large-capacity hard disc, an E-mail can be transmitted/ 
received without being particularly concerned with the 
data size. 

[0004] Moreover, in transmitting/receiving an E-mail, 
it is a frequent occurrence that not only the so-called 
text data but also data rendered into a file is attached 
and transmitted/received. This data rendered into a file 
is referred to below simply as a file. For opening the at- 
tached file at a reception terminal, an application soft- 
ware associated with the file form (type of the attached 
file), inclusive of a mailer, is necessary. 
[0005] in transmitting/receiving an E-mail with a file 
attached thereto, if a reception terminal is a general pur- 
pose computer having the above-mentioned large-ca- 
pacity hard disc, the attached file can be opened by pre- 
installing an application software associated with each 
of a variety of file formats. Of course, if the application 
software associated with the file format of the attached 
file is not installed in the general purpose computer of 
the reception terminal, the attached file, stored previ- 
ously, may be opened by installing an application soft- 
ware associated with the file format after once storing 
the received attached file. Meanwhile, if the file need not 
be opened directly, but it is sufficient to see its contents, 
it is sufficient if a so-called viewer software associated 
with each of a variety of file formats is installed. On the 
other hand, if a file is attached, the data size tends to be 
increased as compared to an E-mail comprised only of 
text data. However, if a reception terminal is a general 
purpose computer having a large-capacity hard disc, the 
E-mail can be transmitted/received, by using the hard 
disc as data recording means, without the user being 
particularly concerned with the size of the attached file, 
[0006] If an E-mail, inclusive of an attached file, is 
transmitted/received using a general purpose computer, 
it has not been necessary to be particularly concerned 
with the data size or the file format, as described above. 
[0007] Recently, not only the genera! purpose compu- 
ter, such as the above-mentioned personal computer or 
workstation, but also a variety of portable information 



terminals, such as PDA (personal digital assistants) car- 
rying a general-purpose OS (Operating system), a port- 
able telephone set, a simplified portable telephone sys- 
tem, such as PHS (registered trademark) or a pager ter- 

5 minal, are in use. These terminals are referred to below 
collectively as portable telephone sets. In near future, a 
variety of electronic equipment, such as, for example, 
video cameras, digital still cameras, AV (audio visual) 
equipment, game machines for domestic use, set top 

10 boxes or a variety of household electrical products, may 
presumably be used as E-mail reception terminals, 
[0008] However, the portable information terminals, 
such as the above-mentioned PDA, portable telephone 
sets or pager terminals, are in general poor in recording 

15 capacity of enclosed storage means, such that it is fre- 
quently difficult to get installed, or newly install, an ap- 
plication software, inclusive of viewer software, adapted 
to cope with a variety of file formats : used for opening 
or viewing a file attached to a variety of file formats. 

20 [0009] On the other hand, a portable information ter- 
minals carrying a dedicated OS, such as PDA or porta- 
ble telephone set, adapts itself in many cases only to 
predetermined file formats, so that, in such case, this 
portable information terminal is only able to open or view 

25 an attached file of the predetermined file format, while 
it is unable to open or view an attached file other than 
the attached file of the predetermined format. Stated dif- 
ferently, if an E-mail with a file attached thereto is to be 
transmitted to a portable information terminal carrying 

30 the dedicated OS, it becomes necessary to provide and 
transmit an attached file of a predetermined file format 
associated with the dedicated OS. 
[0010] In particular, in the case of the above-men- 
tioned portable telephone set, it may be a frequent oc- 

35 currence that respective portable telephone sets differ 
in specifications or OS types, depending on the differ- 
ence in the communication system used or in the port- 
able telephone service offering companies furnishing 
portable telephone sen/ices. So, it may be a frequent 

*o occurrence that the file formats that can be opened or 
viewed are also different. If the communication system 
is the same or the portable telephone set pertains to the 
same portable telephon e service company, it may be an 
occurrence that the file formats that can be opened or 

45 viewed differ depending on the OS versions or with 
equipment types. 

[0011] It is a frequent occurrence that updating or re- 
writing of an application software by users at large is not 
possible, even though the application software can be 

50 updated or rewritten in a producer or a servicing center 
for the portable information terminals. So, the users at 
large can only use the application installed from the out- 
set, except if the application software is rewritten at e. 
g., a servicing center. 

55 [0012] It is also a frequent occurrence that the above- 
mentioned portable information terminals cannot dis- 
play the information only in a state matched to the dis- 
play capability of respective own display means. In such 
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case, even if a reception terminal accommodates the 
file format itself of the attached file, and is able to open 
the file, but the image size or the maximum number of 
colors for demonstrating the contents of the opened file, 
for example, exceeds the display capability of the dis- 5 
play means of the reception terminal, the file contents 
cannot be opened or viewed. 

[001 3] It may be contemplated from above that, even 
if, when the various portable information terminals re- 
ceive E-mails, the text data excepting letters or charac- 10 
ters unique to terminals can be viewed unobjectionable 
it may occur frequently that the attached file received 
frequently cannot be opened or viewed, since this de- 
pends appreciably on the capability or the file format that 
can be accommodated by the reception terminal. 15 
[001 4] If a variety of electronic equipment, such as the 
aforementioned video cameras, digital still cameras, AV 
equipment or household electrical devices, provided 
with the E-mail receiving functions, and which will debut 
in near future, a similar problem presumably arises that 20 
a file transmitted as it is attached to the E-mail cannot 
be opened or viewed, as in the case of the portable in- 
formation terminal, described above, because the oper- 
ating systems or functions set on the electronic equip- 
ment will possibly differ from one equipment to another. 25 

SUMMARY OF THE INVENTION 

[0015] Embodiments of the present invention seek to 
provide an information processing method and appara- 30 
tus, an information processing system and a medium 
whereby, in transmitting an E-mail having a file attached 
thereto and opening or viewing the attached file in a re- 
ception terminal, the contents of the attached file can be 
displayed at the reception terminal irrespective of the 35 
file format of the file transmitted as it is attached to the 
E-mail, the picture size for demonstrating the file con- 
tents, or of the maximum number of colors, 
[001 6] Embodiments of the present invention relate to 
a method and apparatus, an information processing 40 
system, and a medium, which may be used with advan- 
tage in transmitting/ receiving an E-mail with a file at- 
tached thereto. 

[0017] In one aspect, the present invention provides 
a information processing apparatus for transmitting the 45 
information to be transferred to a reception terminal, in- 
cluding accommodating capability verifying means for 
verifying the information accommodating capability in 
the reception terminal orin a communication system en- 
compassing the reception terminal, based on the desti- so 
nation information in sending the transfer information to 
the reception terminal, information converting means for 
converting the transfer information to be transmitted in 
meeting with the information accommodating capability 
in the reception terminal or in the communication system 55 
encompassing the reception terminal if the information 
accommodating capability in the reception terminal or 
in the communication system encompassing the recep- 



tion terminal is not matched to the transfer information 
to be transmitted, and transmission means for transmit- 
ting the transfer information. 

[0018] In another aspect, the present invention pro- 
vides an information processing method for transmitting 
the information to be transferred to a reception terminal, 
including verifying the information accommodating ca- 
pability in a reception terminal or in a communication 
system encompassing the reception terminal, based on 
the destination information in sending the transfer infor- 
mation to the reception terminal, converting the transfer 
information to be transmitted in meeting with the infor- 
mation accommodating capability in the reception ter- 
minal or in the communication system encompassing 
the reception terminal if the information accommodating 
capability in the reception terminal or in the communi- 
cation system encompassing the reception terminal is 
not matched to the transfer information to be transmit- 
ted, and transmitting the transfer information. 
[0019] In still another aspect, the present invention 
provides an information processing system including 
one or more reception terminals and one or more trans- 
mission terminals, in which the transmission terminal 
sends the transfer information to a desired reception ter- 
minal including accommodating capability verifying 
means for verifying the information accommodating ca- 
pability in the reception terminal or in a communication 
system encompassing the reception terminal, based on 
the destination information in sending the transfer infor- 
mation to the reception terminal, information converting 
means for converting the transfer information to be 
transmitted in meeting with the information accommo- 
dating capability in the reception terminal or in the com- 
munication system encompassing the reception termi- 
nal if the information accommodating capability in the 
reception terminal or in the communication system en- 
compassing the reception terminal is not matched to the 
transfer information to be transmitted, and transmission 
means for transmitting the transfer information. The re- 
ception terminal includes reception means for receiving 
the transfer information sent from the transmission ter- 
minal and information opening means for opening the 
transfer information received. 

[0020] In still another aspect, the present invention 
provides an information processing method including 
verifying the information accommodating capability in 
the reception terminal or in a communication system en- 
compassing the reception terminal based on the desti- 
nation information in transmitting the transfer informa- 
tion to the reception terminal, converting the transfer in- 
formation to be transmitted in meeting with the informa- 
tion accommodating capability in the reception terminal 
or in the communication system encompassing the re- 
ception terminal if the information accommodating ca- 
pability in the reception terminal or in the communication 
system encompassing the reception terminal is not 
matched to the transfer information to be transmitted, 
transmitting the transfer information and opening the 
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transfer information received. 

[0021] In still another aspect, the present invention 
provides a medium for causing an information process- 
ing apparatus to execute a program including a step of 
verifying the information accommodating capability in a 5 
reception terminal or a communication system encom- 
passing the reception terminal based on the destination 
information in sending the transfer information to a re- 
ception terminal, a step of converting the transfer infor- 
mation transmitted in keeping with the information ac- 10 
commodating capability in the reception terminal or a 
communication system encompassing the reception 
terminal if the information accommodating capability in 
the a reception terminal or the communication system 
encompassing the reception terminal is not matched to 15 
the transfer information transmitted, and a step of send- 
ing the transfer information. 

[0022] In yet another aspect, the present invention 
provides a medium for causing an information process- 
ing apparatus to execute a program including a step of 20 
verifying the information accommodating capability in a 
reception terminal or a communication system encom- 
passing the reception terminal based on the destination 
information in sending the transfer information to a re- 
ception terminal, a step of converting the transfer infor- 25 
mation transmitted in keeping with the information ac- 
commodating capability in the reception terminal or a 
communication system encompassing the reception 
terminal if the information accommodating capability in 
the a reception terminal or the communication system 30 
encompassing the reception terminal is not matched to 
the transfer information transmitted, a step of sending 
the transfer information, a step of receiving the transfer 
information transmitted and a step of opening the trans- 
fer information received. 35 
[0023] According to embodiments of . the present in- 
vention, the information accommodating capability in a 
reception terminal or in a communication system en- 
compassing the reception terminal is verified on the ba- 
sis of the destination information in sending the transfer 40 
information to the reception terminal. If the information 
accommodating capability is not matched to the transfer 
information transmitted, the information is transmitted 
after conversion in keeping with the information accom- 
modating capability, so that, when the E-mail with an at- 45 
tached file is sent as the information for transmission 
and the attached file is opened or viewed at the recep- 
tion terminal, the contents of the attached file can be 
displayed at the reception terminal irrespective of the 
file format of the attached file sent attached to the E- s° 
mail, the image size or the maximum number of colors 
in displaying the file contents. 

[0024] Further particular and preferred aspects of the 
present invention are set out in the accompanying inde- 
pendent and dependent claims. Features of the depend- 55 
ent claims may be combined with features of the inde- 
pendent claims as appropriate, and in combinations oth- 
er than those explicitly set out in the claims. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0025] The present invention will be described further, 
by way of example only, with reference to preferred em- 
bodiments thereof as illustrated in the accompanying 
drawings, in which: 

Fig. 1 shows an overall system structure of an em- 
bodiment of the present invention. 
Fig. 2 is a perspective view of a notebook personal 
computer according to an embodiment of the 
present invention. 

Fig.3 is an enlarged view showing the vicinity of a 
jog dial of the notebook personal computer shown 
in Fig. 1 . 

Fig. 4 is a block circuit diagram showing an electrical 
structure of the interior of the notebook personal 
computer shown in perspective in Fig.1 . 
Fig. 5 is a flowchart showing the overall processing 
flow from photographing an image and preparation 
of an image file until transmission of an E-mail hav- 
ing the image file attached thereto as an attached 
file. 

Fig. 6 shows an exemplary display on a desktop 
screen of a personal computer in case an E-mail 
program of the present embodiment is booted and 
a capture program is also booted in conjunction 
therewith. 

Fig. 7 is a flowchart showing detailed flow of a mail 
transmission processing at step S4 in Fig.5. 
Fig. 8 shows an exemplary display of a dialog for 
profile selection. 

Fig. 9 shows an exemplary display of a dialog for 
confirming profile setting. 

Fig. 10 shows an exemplary display of a dialog for 
confirming profile setting when a correction button 
is clicked on a profile setting confirming dialog 
shown in Fig. 9. 

Fig. 11 shows an exemplary display of a dialog in 
mail transmission. 

Fig. 1 2 is a flowchart showing detailed flow of deci- 
sion processing at a reception terminal at step S12 
in Fig. 7. 

Fig. 13 is a flowchart showing detailed flow of 
processing for preparation of an image for transmis- 
sion at step S1 2 in Fig. 7. 

Fig. 14 shows an exemplary inner structure of a 
portable telephone set fitted with a camera and an 
external memory IF. 

Fio 1 5 is an overall view showing the side of a col- 
lac Me portable telephone set carrying keys and a 
display, looking from the front side. 
Fig. 16 is a right-hand side view showing a portable 
telephone set shown in Fig. 15. 
Fig. 17 is an overall view showing the portable tel- 
ephone set shown in Fig. 15, in the collapsed state, 
looking from the direction indicated by arrow A in 
Fig. 16. 
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Fig. 1 8 is a right-hand side view showing a portable 
telephone set in the collapsed state shown in Fig. 
17. 

Fig. 19 is an overall view showing the portable tel- 
ephone set shown in Fig. 1 5, in the collapsed state, 5 
looking from the direction indicated by arrow B in 
Fig. 16, 

DESCRIPTION OF THE PREFERRED 

EMBODIMENTS 10 

[0026] Referring to the drawings, a preferred embod- 
iment of the present invention will be explained in detail. 
[0027] First, schematics of a technique as adopted in 
the present embodiment, whereby, in transmitting an E- is 
mail as a file is attached thereto, and in opening or view- 
ing the file so attached in a reception terminal, the con- 
tents of the attached file can be displayed in the recep- 
tion terminal irrespective of the file format of the at- 
tached file transmitted with the E-mail, the image size 20 
of the image demonstrating the file contents, or the max- 
imum number of colors, are explained. In the following 
explanation, a reception terminal embodying the 
present invention is a portable telephone set, inclusive 
of a simplified portable telephone system terminal, and 25 
an E-mail having a file attached thereto is transmitted to 
the portable telephone set. However, the reception ter- 
minal is not limited to the portable telephone set, but 
may also be a variety of portable information terminals, 
such as PDA or pager terminals, video cameras, digital so 
still cameras, AV equipment, household game ma- 
chines, set top boxes or a variety of household electrical 
equipment. Also, in the following explanation, an image 
file of a still image is taken as an example of a file at- 
tached to a portable telephone set, as a reception ter- 35 
minal. However, the file is not limited to an image file, 
and may also be a file of speech, music or moving pic- 
tures. There is also no limitation as to the file format. 
Moreover, although the attached file is converted in the 
present embodiment, by way of an example, embodi- *o 
ments of the present invention encompass the function 
of converting the format of a main text of the E-mail into 
a format that can be accommodated by a reception ter- 
minal in case the format of the main text of the E-mail 
itself at the transmission terminal is not matched to that 45 
in the reception terminal. 

[0028] In general, in transmitting an E-mail, there nec- 
essarily exists the mail address of a counterpart side. 
The mail address is represented e.g., as [aaaa @ bbbb. 
cc.dd] or as aaaa @ bbbb.dd], with the number of letters so 
being arbitrary. The [aaaa] ahead of @ is the information 
for identifying a user receiving the E-mail, and may be 
set arbitrarily by a user, wherein there may be a sole or 
plural number of user terminals. The [bbbb .cc.dd] or the 
[bbbb.dd], at back of @ , is termed a domain name, used 55 
for identifying a company, organization, E-mail servicing 
company, an Internet provider or a personal computer 
communication firm, and is set from one company or E- 



mail servicing company etc., to another. Meanwhile, the 
[.dd] at the trailing end of the domain name is classified 
into a top level domain as set from territory to territory 
and a general top level domain as set irrespective of the 
territory. 

[0029] If the reception terminal is a portable telephone 
set, the domain name is set in a majority of cases from 
one portable telephone servicing company to another, 
so that it is probably possible to identify the portable tel- 
ephone servicing company from the domain name of the 
mail address of the transmitted E-mail. That is, if it can 
be specified from the domain name of the mail address 
of the transmitted E-mail to which of the portable tele- 
phone servicing companies corresponds the portable 
telephone set, it presumably becomes possible to spec- 
ify the type of the portable telephone set, file format that 
can be accommodated by the portable telephone set, 
such as image format, the maximum size of the E-mail 
that can be accommodated by the portable telephone 
set, the maximum file size of the display means of the 
portable telephone set, or the maximum pixel size or the 
maximum number of colors, these being hereinafter 
termed capabilities accommodated, as appropriate. 
[0030] So, if the capabilities accommodated by the 
portable telephone set as reception terminal are known 
as described above, it becomes possible for the E-mail 
transmission terminal to convert the file format etc. : in 
keeping with the capabilities accommodated to transmit 
the as-converted file as it is attached to an E-mail trans- 
mitted to permit the portable telephone set on the re- 
ceiving side to open the attached file, that is to open and 
display the image file. 

[0031] Meanwhile, if, when an image file is transmit- 
ted from a transmission terminal as a file attached to an 
E-mail, the reception terminal is inherently not adapted 
to image display, as when the reception terminal is able 
to display the text but is not provided with the function 
of displaying an image, it may be contemplated to insert 
automatically an URL (uniform resource locator) for 
viewing the image file into the main text of the E-mail 
and to transmit the resulting E-mail. This enables a user 
at the reception terminal to view an image of the image 
file using e.g., an equipment enabling an image file to 
be viewed, such as a personal computer. On the other 
hand, if, when an image file is transmitted from a trans- 
mission terminal as a file attached to an E-mail, the re- 
ception terminal is adapted to an image file of a still im- 
age but is not adapted to an image file of a moving pic- 
ture, it may be contemplated to prepare only an initial 
frame of the moving picture or a sole frame character- 
istic of the moving picture, as an image file of a still im- 
age, and to transmit the so-prepared image file as an 
attached file to the reception terminal, as well as to 
transmit an E-mail, along with URL, used for viewing the 
image file of the moving picture, automatically inserted 
into e.g., a main text of the E-mail. This enables a user 
at the reception terminal to view the moving picture with 
the image file of the moving picture attached to the E- 
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mail, using an equipment enabling the image file to be 
viewed, such as, for example, a personal computer. This 
can be done not only for an image file but also for audio 
or music files. 

[0032] There may be occasions where the capabilities 
accommodated by the reception terminal cannot be de- 
termined from only the domain name of the E-mail ad- 
dress. In such case, the supplementary information in- 
dicating the capabilities accommodated by the recep- 
tion terminal is used. This supplementary information is 
such information that can be acquired by making inquir- 
ies at a server who retains the capabilities accommo- 
dated by plural reception terminals in the form of tables 
or lists, or the information acquired on designation by a 
user on the transmission terminal: 
[0033] That is, if the capabilities accommodated by 
the reception terminal cannot be determined from only 
the domain name of the E-mail address, the transmis- 
sion terminal may have communication with e.g., the 
above-mentioned server to acquire the supplementary 
information representing the capabilities accommodat- 
ed by the reception terminal, or to acquire the supple- 
mentary information on request from a user to recognize 
the capabilities accommodated by the reception termi- 
nal from the so-acquired supplementary information to 
convert the file attached to the E-mail in keeping with 
the capabilities accommodated by the reception termi- 
nal to transmit the so-converted file. 
[0034] In this manner, if the information from the do- 
main name of the E-mail address is insufficient to verify 
the capabilities accommodated by the reception termi- 
nal, it is possible for a reception terminal to open or view 
the attached file. 

[0035] Of course, the supplementary information can 
be used even in such a case wherein the capabilities 
accommodated by the reception terminal can be deter- 
mined from the domain name of the E-mail address. 
That is, in such case, it is possible to determine only 
coarsely the capabilities accommodated by the recep- 
tion terminal, from the domain name of the E-mail ad- 
dress, and to use the supplementary information further 
to effect file conversion matched more finely to the ca- 
pabilities accommodated by the reception terminal. 
[0036] Based on the technique used in the above-de- 
scribed embodiment of the present invention, an illus- 
trative structure of a system embodying the present in- 
vention, exemplary structures of the transmission and 
reception terminals and an exemplary operation of the 
system and the terminals, are hereinafter explained. 
[0037] Fig. 1 shows an overall illustrative structure of 
the system embodying the present invention. It should 
be noted that this structure is merely exemplary and is 
not intended to limit the invention. 
[0038] Referring to Fig.1 , one or more radio base sta- 
tions 302 are arranged in a geographically distributed 
fashion and a set of several near-by radio base stations 
make up a local area. A set of plural local areas of the 
radio base stations 302 make up a service area of the 



mobile communication system. 

[0039] Each of the mobile stations 303, 304 and 307, 
each of which may be plural, is made up of portable tel- 
ephone sets 304, 307, having call and data communi- 

5 cation functions, or a portable information terminal 303, 
such as a PDA, having the data communication func- 
tions and radio accessing functions, and is connected 
over a radio network to the near-by base station in a cell 
formed by each of the radio base stations 302. Although 

10 there is no particular limitation in the present embodi- 
ment to the radio accessing system between the radio 
base station 302 and the mobile stations 303, 304, 307, 
there are a variety of the radio accessing systems, such 
as, for example, so-called TDMA-TDD system, CDMA 

15 system or the W-CDMA system. It is noted that there 
can be connected e.g., multi-media communication ter- 
minals 305 or personal computers to each mobile sta- 
tion, whilst a monitor 306 can be connected to the multi- 
media communication terminals 305. 

20 [0040] On the other hand, each of the radio base sta- 
tions 302 is connected over e.g., a wired network to a 
public network 300, which is provided e.g., with ISDN 
(Integrated Services Digital Network) and an interfacing 
network for housing each of the radio base stations 302 

25 jn this ISDN. To this public network 300 are connected 
a large number of wired subscriber terminals, a compu- 
ter network or an intra-company network. In the case of 
the Internet, for example, an access server 311 of the 
Internet service provider is connected to the ISDN. It is 

30 via this access server 311 that the public network 300 
is connected to the Internet. A large number of WWW 
(worldwide web) servers 313 are connected to the In- 
ternet 310 and, by using this TCP/IP protocol, these 
WWW servers 313 can be accessed from the wired sub- 

35 scriber terminals or from the above-mentioned mobile 
stations. 

[0041] To the access server 311 is connected a con- 
tents server 31 2 owned by the Internet service provider. 
This contents server 31 2 has the functions of furnishing 

40 various information including moving pictures respon- 
sive to requests from the wired subscriber terminals and , 
from the mobile stations. Meanwhile, a management 
control device 301 serves for the mobile communication 
network by performing authentication or assessment 

45 processing for each mobile station. 

[0042] Among wired subscriber terminals, connected 
to the internet 310, there are a variety of electronic 
equipment, such as personal computers 31 4, 315, hav- 
ing the Internet browser installed therein, household 

so game machines 31 6, each having the Internet browser 
functions, set top boxes 318, and other electrical devic- 
es, not shown, such as video cameras, digital still cam- 
eras, AV equipment and household electrical utensils or 
devices. Meanwhile, the household game machines 

55 316, set top boxes 31 8 and other electronic equipment 
are connected to a monitor 31 7 as necessary. 
[00431 If, in the system configuration, shown in Fig. 1 , 
the portable telephone set 304, in the above-mentioned 



6 



SNSDOCID: <EP 1 1 50465A2J„> 



11 EP1 150 465 A2 12 



mobile stations, is used as a reception terminal, a per- 
sonal computer 315 having a camera and an external 
memory interface IF is used as a transmission terminal, 
and an E-mail having a file attached thereto is transmit- 
ted from the camera and the external memory interface 
IF, the personal computer 315 verifies, with the aid of 
the supplementary information as necessary, the capa- 
bilities of the portable telephone set, from the domain 
name of the E-mail address to the portable telephone 
set as the reception terminal as described above, to 
transmit the E-mail with an attached file now converted 
to cope with the capabilities of the portable telephone 
set of the reception terminal. 

[0044] The structure and the operation of the personal 
computer 315, in case an E-mail with an attached file is 
transmitted to the portable telephone set of the recep- 
tion terminal, using the personal computer 3 15 having 
a camera and an external memory interface IF, as a re- 
ception terminal/are hereinafter explained. 
[0045] Figs.2 and 3 illustrate the appearance of a 
notebook personal computer 1 , as the personal compu- 
ter 315 having a camera and an external memory inter- 
face IF, as an embodiment of the present invention. Ba- 
sically, the notebook personal computer 1 is made up of 
a main body unit 2, and a display unit 3 that can be 
opened or closed with respect to the main body unit 2. 
Figs.2 and 3 show a perspective view showing the dis- 
play unit 3 opened with respect to the main body unit 2 
and an enlarged view showing a jog dial 4 provided on 
the main body unit 2 and a near-by portion. 
[0046] The main body unit 2 includes, on its upper sur- 
face, a keyboard 5, acted on when inputting a variety of 
letters or symbols, a touch pad 6 as a pointing device 
acted on in moving a pointer (mouse cursor), and a pow- 
er source switch 8, while including, on its lateral surface, 
the jog dial 4 or an IEEE 1394 input/output port 101. 
Meanwhile, a stick type pointing device may also be pro- 
vided in place of the touch pad 6. 
[0047] On the front side of the display unit 3 is mount- 
ed an LCD (liquid crystal display) 7 for displaying an im- 
age. On the upper right side of the display unit 3, there 
are provided a power source lamp PL, a battery lamp 
BL, a message lamp ML, as necessary, and other lamps 
formed by LEDs (light emitting diodes). On e.g., the up- 
per mid portion of the display unit 3, there are provided 
a CCD video camera 102 having a charge coupled de- 
vice (CCD) and a microphone 104. On e.g., an upper 
right portion of the main body unit 2, there is provided a 
shutter button 105 of the CCD video camera 102. The 
CCD video camera 1 02 is provided on a rotational driv- 
ing movement mechanism 103 which renders a lens unit 
of the camera rotationally movable with respect to e.g., 
the display unit 3. Meanwhile, the power source lamp 
PL, a battery lamp BL orthe message lamp ML may also 
be provided on a lower portion of the display unit 3. 
[0048] The jog dial 4 is built on e.g., a right end of the 
keyboard 5 on the main body unit 2 and is mounted sub- 
stantially flush with each keyboard key. The jog dial 4 is 



responsive to the rotational operation in the direction in- 
dicated by arrow ato execute pre-set operations in order 
to execute the operation associated with the movement 
in the direction indicated by arrow bin Fig.3. Meanwhile, 

5 the jog dial 4 may be arranged on the left lateral side of 
the main body unit 2, on the left or right side lateral sur- 
face of the display unit 3 provided with the LCD 7, or on 
a line passing through keys G and H of the keyboard 5. 
The jog dial 4 may also be arranged centrally of the front 

10 surface to permit it to be operated with a thumb finger 
as the touch pad 6 is operated with an index finger. Al- 
ternatively, the jog dial 4 may be provided in a line pass- 
ing through right and left buttons of the touch pad 6. 
Moreover, the jog dial 4 may be arranged in an oblique 

15 direction at a pre-set angle, instead of being arranged 
in the horizontal direction or in the vertical direction, for 
facility in operation with respective fingers. The jog dial 
4 may also be arranged at a position on the lateral sur- 
face of a mouse as a pointing device that permits facil- 

20 jtated operation with the thumb finger. As the jog dial , a 
rotary electronic component fitted with a push switch, as 
disclosed in Japanese Laying-Open Publication H- 
8-203387, filed in the names of the present Assignee 
and other co-assignees, may be used. 

25 [0049] Referring to Fig. 4, an exemplary electrical 
structure of the notebook personal computer 1 of the 
present embodiment is explained, it is noted that a pub- 
lic telephone network 76, an Internet service provider 
77, a communication network 80 and a mail server 78 

30 are connected to the personal computer 1 and are 
shown in one drawing sheet for convenience in expla- 
nation. 

[0050] A central processing unit (CPU) 51 , construct- 
ed as a Pentium (trademark) processor, for example, is 

35 connected to a host bus 52. To this host bus 52 is con- 
nected a northbridge (AGP host bridge controller) 53 
which in turn is connected to an AGP (accelerated 
graphics port) 50 and a PCI bus 56. The northbridge 53 
is connected via AGP 50 to a video controller 57. The 

40 northbridge 53 and a southbridge (PCI-IS A bridge) 58 
make up a so-called chip set. 

[0051] The northbridge 53 is further connected to a 
main memory 54 and to a cache memory 55. The cache 
memory 55 is adapted for caching data used by the CPU 
45 51 . Although not shown, a first-order cache memory is 
enclosed in the CPU 51 . 

[0052] The main memory 54 is built by e.g., a DRAM 
(dynamic read-only memory) and is adapted for storing 
a program executed by the CPU 51 and data required 
50 for the operation of the CPU 51 . Specifically, at a time 
point of end of booting, there are stored in the main 
memory 54 an E-mail program 54A according to the 
present embodiment, an automatic pilot program 54B, 
a jog dial status monitoring program 54C, a jog dial driv- 
es er 54D, and an operating system program (OS) 54E, a 
label forming management program 54F, a capture pro- 
gram 54G, and a document forming program 54H, hav- 
ing the HTML file editing program, as application pro- 
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grams, and other application programs 541 , are trans- 
ferred from an HDD 67 to the main memory 54 for stor- 
age therein . 

[0053] The video controller 57 is connected to the PC! 
bus 56 and, based on data furnished over the PCI bus 
56, controls the display on the LCD 7 of the display unit 
3, while sending video data from the CCD video camera 
102 to the PC! bus. 

[0054] A sound controller 64 is connected to the PCI 
bus 56 and captures the speech input from the micro- 
phone 66 or furnishes speech signals to a loudspeaker 
65. A modem 75 is also connected to the PCI bus 56. 
[0055] The modem 75 can be connected through the 
Internet service provider 77 to the communication net- 
work 80, such as the Internet, or to the mail server 78. 
[0056] The southbridge 58 is also connected to the 
PCI bus 56. The southbridge 58 is constructed by e.g., 
PIIX4E manufactured by INTEL INC. to control a variety 
of input/output units. That is, the southbridge 58 is 
formed by IDE (integrated drive electronics) controller/ 
configuration register 59, a timer circuit 60, and by an 
IDE interface 61, and is configured for controlling devic- 
es connected over an IS A/EIO (industry standard ar- 
chitecture/extended input output) bus 63 and an embed- 
ded controller 68. 

[0057] The IDE controller/configuration register 59 is 
made up of two IDE controllers, namely a so-called pri- 
mary IDE controller, not shown, and a secondary IDE 
controller, and a configuration register, also not shown. 
[0058] The primary IDE controller is connected over 
an IDE bus 62 to a connector, not shown. To this con- 
nector is connected the HDD 67. The secondary IDE 
controller is designed so that, when bay devices, as so- 
called IDE devices, such as CD-ROM drives, second 
HDD or FDD, not shown, are loaded over another IDE 
bus, the secondary IDE controller is electrically connect- 
ed to connectors of the so-loaded bay devices. 
[0059] To the IS A/EIO bus 63 is further connected an 
embedded controller 68 which is comprised of a micro- 
controller and used as an I/O controller. Thus, the em- 
bedded controller 68 is comprised of an interconnection 
of an I/O interface 69, a ROM 7Q, a RAM 71 and a CPU 
72. 

[0060] In the ROM 70 are pre-stored an LED control 
program 70A, a touch pad input monitor program 70B, 
a key input monitor program 70C, a wakeup program 
70D, a jog dial status monitor program 70E S an IEEE 
1394 l/F program 70G and an external memory IF pro- 
gram, not shown. 

[0061 ] The LED control program 70A is a program for 
controlling the lighting of LED lamps, namely a power 
source lamp PL, a battery lamp BL, a message lamp 
ML, as necessary, and other LED lamps. Th touch pad 
input monitor program 70B is used for monitoring the 
inputting by the user from the touch pad 6. The key input 
monitor program 70C is a program for monitoring the 
inputting from the keyboard 5 or from other key switch- 
es. The wakeup program 70D is used for supervising 



14 

each chip by checking whether or not the time is the pre- 
set time, based on the current time data furnished from 
the timer circuit 60 in the southbridge 58 , for booting pre- 
set processing or program. The IEEE 1394 l/F program 

5 70G is a program for executing l/F of data conforming 
lo IEEE 1394 transmitted/received over the IEEE 1394 
input/output port 101. The jog dial status monitor pro- 
gram 70E is used for perpetually monitoring whether or 
not a rotary encoder unit 12 of the jog dial 4 has been 

10 rotated or thrust. The external memory IF program is a 
processorfor transmitting/receiving data through an ex 1 
ternal IF memory 106 between it and a removable ex- 
ternal memory medium, not shown, having a stick-, 
card- or stamp-like semiconductor memory, not shown, 

15 enclosed in casing. 

[0062] In the ROM 70 is further written a BIOS70F. 
The BIOS (basic input/output system) means a basic in- 
put/output system and is a software program for control- 
ling data exchange (input/output) between the OS orthe 

20 application program and a peripheral, such as a display, 
keyboard or HDD. 

[0063] The RAM 71 includes, as registers 71 A to 71 F, 
registers for LED control, touch pad input status, key in- 
put status and for time setting, an I/O register for mon- 

25 itoring the jog dial status, an IEEE1 394 i/F register and 
a register for external memory IF register. For example, 
when the jog dial 4 is thrust, the LED control register 
controls the lighting of the message lamp ML displaying 
the instantaneous E-mail starting status. When the jog 

30 dial 4 is thrust (pushed), an operating key flag is stored 
in the key input status register. The setting time register 
can be set at an optional time point. 
[0064] To this embedded controller 68 are connected 
the jog dial 4, touch pad 6, keyboard 5, IEEE1 394 input/ 

35 output port 101 and the shutter button 105, through a 
connector, not shown, so that signals associated with 
the operations of the jog dial 4, touch pad 6, keyboard 
5 and the shutter button 105 will be output to the IS A/ 
EIO bus 63, and so that data will be transmitted/received 

40 to or from outside through the IEEE1394 input/output 
port 101 . To the embedded controller 68 are also con- 
nected LED lamps, such as a power source lamp PL, a 
battery lamp BL, a message lamp ML, as necessary, and 
other LED lamps. 

45 [0065] A power source control circuit 73 is connected 
to an enclosed battery 74 or to an ACCOMMODATING 
CAPABILITY power source for furnishing the necessary 
power to each block and for exercising control to charge 
secondary batteries of the peripheral devices. The em- 

50 bedded controller 68 monitors the power s irce switch 
8 which is operated for turning the power jrce on or 
off. 

[0066] The embedded controller 68 is able to execute 
the programs 70A to 70E and 70G : by the internal power 
55 source , even if the power source 8 is turned off. That is, 
these programs are run at all times even if no window 
is open on the LCD 7 of the display unit 3. That is, the 
embedded controller 68 causes the jog dial status mon- 
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itor program 70E to be run perpetually even if the power 
source switch 8 is off and hence the OS 54E is not boot- 
ed by the CPU 51 , such that the notebook personal com- 
puter 1 may be endowed with the function of a program- 
mable power key (PPK) function, even if the notebook 
personal computer 1 is not provided with a dedicated 
key, so that, in the power saving state or in the power 
source off state, a desired software or a script file can 
be booted simply by the user thrusting the jog dial 4. 
[0067] in the HDD 67, there are stored an E-mail pro- 
gram 67A, an autopilot program 67B, a jog dial status 
monitor program 67C, a jog dial driver Jog dial driver 
67D, an OS (basic program software) 67E, a label prep- 
aration management program 67F, a capture program 
67G, a document preparation program 541 and other 
application programs 67! . These programs 67A to 67! 
in the HDD 67 are sequentially transferred into the RAM 
54 for storage therein in the course of the boot-up 
processing. 

[0068] The E-mail program 67A exchanges a commu- 
nication message over e.g., a network and modem 75 
from e.g., a communication circuit, such as a telephone 
network 76, while checking for the capabilities accom- 
modated by the reception terminal, based on the domain 
name of the E-mail address to the reception terminal, 
as described above, using the supplementary informa- 
tion as necessary, to transmit an E-mail to which is at- 
tached a file now converted to cope with the capabilities 
accommodated by the reception terminal. The E-mail 
program 67A also has the function of acquiring the on- 
coming mail as a specified function. This oncoming mail 
acquiring function ascertains whether or not a mail ad- 
dressed to the user has arrived at a mail box 79 of the 
mail server 78 in the provider 77 to acquire a mail ad- 
dressed to the user, if there is any. 
[0069] The autopilot program 67B sequentially boots 
pre-set plural processing operations in a pre-set se- 
quence by way of processing. 

[0070] The OS (basic program software) 67E re- 
ceives a notice from each application program as to 
whether or not a jog dial is coped with and, if the result 
is affirmative, displays what can be done by acting on 
the jog dial 4. The jog dial status monitor program 67C 
is usually awaiting an event on the jog dial 4 and has a 
list for receiving a notice from the application program. 
The jog dial driver Jog dial driver 67D executes the var- 
ious functions responsive to the actuation of the jog dial 
4. 

[0071] The label preparation management program 
67F is a program performing the operation of affixing a 
tag sheet as a mark on a paper document or entering a 
memo on the tag sheet and affixing the tag sheet as a 
reminder on a desktop (monitor) screen of a personal 
computer. In the present embodiment, a tag sheet dis- 
played on the desktop screen is termed a label. The la- 
bel preparation management program 67F has a func- 
tion of handling texts, such as letters or symbols, images 
or pictures, such as still images or moving pictures or 



the sound, such as speech or music sound, as an object 
that can be affixed to the label as a tag sheet displayed 
on the desk top, a function of editing the text affixed to 
the label, a function of recording and/or reproducing the 

5 sound affixed to the label, a function of capturing/dis- 
playing a picture, inclusive of the moving picture, affixed 
to the label, and a function of cooperaLing with an appli- 
cation program for capturing an image from a digital 
camera or a CCD camera annexed to the personal com- 

10 puter. Moreover, the label preparation management pro- 
gram 67F has, as the temporal supervising function, a 
function of forming a label having the hysteresis of man- 
aging and changing a schedule, a function of importing 
schedule data from another schedule software and ex- 

15 porting the schedule data to other schedule software, a 
function of fully supporting a jog dial as to the temporal 
supervising function, and a function of handling links as 
objects to be affixed to the label. Typical of the label 
preparation management program is an application pro- 

20 gram for displaying a label as a tag sheet on the desk 
top for realizing a desktop environment capable of per- 
forming time displacement, as disclosed in Japanese 
Patent Application H-1 1-1 08535 (internal priority appli- 
cation of the Japanese Patent Application H- 

25 1 0-321 772), as proposed previously by the present As- 
signee. It is also possible for this label preparation man- 
agement program 67F to capture a file attached to the 
E-mail (label-related file) in cooperation with the E-mail 
program 67A of the present embodiment. 

30 [0G72] The capture program 67G is such an applica- 
tion program having the function of capturing a moving 
picture or a still image from the CCD video camera 1 02, 
digital video camera or a digital still camera, a still image 
from a flathead scanner or from a film scanner, a stick-, 

35 card- or stamp-like external semiconductor memory en- 
closed in a casing, or a still image or a moving picture 
recorded on a recording medium, such as a magnetic 
disc or an optical disc, or furnished from a communica- 
tion network, storing or transferring over a network the 

40 still image or the moving picture as a still image file, in 
a variety of image formats, such as JPEG file, or as a 
moving picture file. The capture program 67G is also 
able to cooperate with the E-mail program 67A of the 
present embodiment to capture the image or picture file 

45 attached to the E-mail. 

[0073] As typical of other plural application programs 
671 , stored in the HDD 67, there are, for example, media 
bar (trademark) as a tool for music-related operating 
tool, a smart pad (trademark) as a free hand writing 

so memo tool employing the touch pad 6, and a schedule 
management tool. With the music-related operating 
tool, the operation of selecting the reproduction of the 
next or' previous music number, pausing or sound re- 
cording, is performed by scrolling e.g., with a jog dial or 

55 a keyboard. With this free hand writing memo tool, the 
touch pad 6 is used as the absolute coordinate detection 
means, and the free hand writing memo input from the 
touch pad 6 is processed by a drawing application pro- 
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gram for display. With each of these programs, the file 
attached to the E-mail, such as audio or free hand writ- 
ing memo file, can be captured in cooperation with the 
E-mail program 67A of the present embodiment. 
[0074] A document forming program (word processor 5 
program) 67H is such an application program which cre- 
ates a document based on an input from the keyboard 
5 or on the free hand writing input from the touch pad 6 
and which enables creation and editing of an HTML file 
having the still image, moving picture or the sound af- 
fixed thereto. As typical of the document forming pro- 
gram, there is a smart write (trademark), in each of these 
programs, the file attached to the E-mail can be cap- 
tured in cooperation with the E-mail program 67A. 
[0075] The processing flow in the E-mail program 67A 
of the present embodiment for capturing an image in co- 
operation with the capture program 67G for generating 
an image file, and verifying the capabilities accommo- 
dated by a reception terminal from the domain name of 
an address of an E-mail to the reception terminal, using 
the supplementary information as necessary, to convert 
the image file in keeping with the capabilities accommo- 
dated by the reception terminal to attach the so-convert- 
ed image file to the E-mail transmitted, and illustrative 
display of e.g., a dialog demonstrated on the desk top 
screen in the course of the processing, are now ex- 
plained. Meanwhile, the processing to be now explained 
is the processing carried out by the CPU 51 of the per- 
sonal computer based on e.g., the aforementioned E- 
mail program or the capture program. 
[0076] First, as a transmission terminal of the present 
embodiment, the overall processing flow from the image 
photographing and image file creation by the personal 
computer 1 , 315 fitted with the camera and the external 
memory I F until transmission of an E-mail along with the 
image file as an attached file, is shown in Fig.5. 
[0077] If, in Fig.5, an E-mail program is booted, an im- 
age is captured, and an E-mail having attached the im- 
age file thereto is created and transmitted, the CPU 51 
first boots a capture program, operated in cooperation 
with the E-mail program, to enable the operation of the 
CCD video camera 1 02. Meanwhile, the image captured 
by the capture program is not limited to an image pho- 
tographed by the CCD video camera 1 02 but may also 
be an image photographed by e.g., a digital video cam- 
era or a digital still camera, an image from a flat head 
scanner or a film scanner, or an image recorded on a 
variety of recording mediums, such as external memo- 
ries. If an image photographed by an externally connect- 
ed video camera or digital still camera, an image read 
out from the recording medium or an image furnished 
over a communication network, is used, instead of an 
image photographed by the CCD video camera 1 02, the 
camera booting processing of step S1 is not carried out, 
such that only the capture program is booted. 
[0078] Then, at step S2, the CPU 51 requests a user 
to input e.g. , a sentence used as a comment of the main 
text of the E-mail, in accordance with the E-mail pro- 



gram, and is at a standby state to await the inputting of 
the sentence by e.g., letters based on the free hand writ- 
ing by the userviae.g.,the keyboards or the touch pad 
6. 

[0079] When next the comment inputting ot step S2 
ends, the CPU 51 is in a stand-by state of awaiting the 
image photographed by the capture program at step S3. 
The CPU 51 then photographs an image and captures 
the photographed image data in accordance with user 
10 commands. If, instead of photographing an image bythe 
CCD video camera 1 02, an image photographed by an 
externally connected video camera or digital still cam- 
era, an image read out from the recording medium, an 
image read out from the recording medium or the image 
15 furnished over a communication network, is used, only 
the processing of capturing these images is performed 
at step S3. It is of course possible to reverse the se- 
quence of the comment inputting processing at step S2 
and the image capturing (photographing processing) at 
20 step S3. 

[0080] Fig. 6 shows an exemplary display on a desk- 
top screen of a personal computer in case the E-mail 
program embodying the present invention is booted 
and, in conjunction therewith, the capture program is al- 
25 so booted. 

[0081] In this state, there are displayed, on the desk- 
top screen , a mail window 230, displayed on booting the 
E-mail program, and a capture window 202, displayed 
on booting the capture program. 
30 [0082] In the mail window 230, there are arrayed a 
capture connection button 231 , a comment inputting ar- 
ea 232, a shot button 233, a mail send button 234 and 
a thumbnail image display area 236. 
[0083] The capture connection button 231 is a virtual 
35 button commanded by the user for booting the capture 
program running in conjunction with the E-mail program. 
The user command may, for example, be a mouse click, 
as in the user commands as hereinafter explained. The 
respective buttons also are virtual buttons. 
40 [0084] The comment inputting area 232 is an area in 
which a user is to input a comment as the main text of 
the E-mail. In the embodiment of Fig.6, there is shown 
such a state in which a comment reading: "a photo is 
now sent" has been input to the comment inputting area 
45 232. 

[0085] The shot button 233 is used for the user to 
command" the image capturing (photographing) via a 
capture program, whilst the mail send button 234 is used 
for the user to command transmission of an E-mail and 
50 the end button 235 is used for the user to command the 
end of the E-mail program. 

[0086] The thumbnail image display area 236 is a dis- 
play area for demonstrating a thumbnail image of an im- 
age captured bythe capture program. 
55 [0087] On the other hand, the capture window 202 is 
basically displayed' on booting the capture program, 
which is able to run independently. However, if the cap- 
ture program is booted responsive to the click of the cap- 
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ture connection button 231 of the mail window 230, the 
capture program is able to run in conjunction with the E- 
mail program of the present embodiment. 
[0088] In the capture window 202, there are provided 
a finder image display area 206 and an application dis- 
play unit 213 for displaying the name of the application 
program running in conjunction with the capture pro- 
gram. In the embodiment of Fig.6, a letter string of [mail] 
is displayed in the application display unit 213 for indi- 
cating that the application program running in conjunc- 
tion with the capture program is the E-mail program. 
[0089] In the capture window 202, there are also pro- 
vided a status display unit 207, a jog dial image 203, a 
jog dial menu 212, an option button 209, an effect button 
21 0 and a capture button 211. 

[0090] In the finder image display area 206, an image 
photographed by e.g., the CCD video camera 1 02, an 
image photographed by an externally connected video 
camera or digital still camera, an image read out from 
the recording medium or an image furnished over a 
communication network is displayed. 
[0091] In the status display unit 207, the status infor- 
mation of an image displayed in the finder image display 
area 206 is displayed. If, for example, the photographing 
mode is the still image photographing mode, the image 
quality mode forthestill image, such as [FINE] Indicating 
the high definition, or the image size, such as 320x240 
pixels, or the unused capacity of a hard disc, is dis- 
played. If the photographing mode is the moving image 
photographing mode, there are displayed in the status 
display unit 207 the maximum possible recording time, 
current recording time and the image size. Meanwhile, 
the image format photographed by the CCD video cam- 
era 1 02 may be arbitrary, such that a BMP (bit map) for- 
mat, for example, may be used. 

[0092] The option button 209 is acted on in designat- 
ing e.g., the imaging mode, while the effect button 210 
is acted on when it is desired to apply an effect to the 
photographed image. The capture button 211 is a button 
having a function equivalent to the shutter button 1 05 
as a mechanical button and acted on when starting the 
• photographing. 
[0093] The jog dial image 203 is a displayed image 
portion which is changed responsive to actuation of the 
jog dial 4. Specifically, an animation image in which the 
jog dial image 203 is rotated, by way of an example, is 
displayed with rotation of the jog dial 4. Moreover, as the 
jog dial 4 is rotated, the items in the jog dial menu 212 
are changed responsive to the rotation of the jog dial 4. 
Among the items of the jog dial menu 212 demonstrated 
in the capture window 202, there are, for example, 
[STILL] indicating the still image photographing mode, 
[VIDEO] indicating the moving image photographing 
mode, letter strings or icons for transferring still images 
or moving images as photographed. Of these items, a 
desired one can be selected by actuation on the jog dial 
4. 

[0094] In the finder image display area 206 of the cap- 



ture window 202, there are displayed an image photo- 
graphed e.g., by the CCD video camera 1 02, externally 
connected video cameras or digital still cameras, an im- 
age read out from the recording medium or an image 

5 furnished over a communication network. A thumbnail 
image displayed in the thumbnail image display area 
236 of the mail window 230 is a thumbnail image of an 
image displayed in the finder image display area 206 of 
the capture window 202. 

10 [0095] Reverting to Fig. 5, if, after capturing of a com- 
ment of the main text of the E-mail and the image file 
attached to the E-mail has come to a close, the user 
clicks the mail send button 234 on the mail window 230 , 
the CPU 51 proceeds to step S4 for transmitting the E- 

15 mail having the image file attached thereto in accord- 
ance with the E-maii program. The mail transmitting 
processing at this step S4 will be explained subsequent- 
ly. 

[0096] When mail transmission at step S4 has come 

20 to a close, the CPU 51 decides at step S5 whether the 
processing is to be repeated or terminated, in accord- 
ance with user instructions as to whether the processing 
is to be continued, such as by sending the E-main again, 
or the application is to be terminated, if it is decided at 

25 step S5 that the processing is to be continued, process- 
ing reverts to step S2. If it is decided that.the end button 
235 is clicked by the user such that the application is to 
be terminated, the E-mail program is closed. 
[0097] Ftg.7 shows detailed mail transmission 

30 processing flow at step S4 of Fig.6. 

[0098] If, in the flowchart of Fig.6, processing pro- 
ceeds to the main transmission processing at step S4, 
the CPU 51 specifies an address of an E-maii (mail ad- 
dress) at step S1 1 of Fig.7. if, in the processing at this 

35 step S1 1 , the mail address of the destination has already 
been registered, a desired mail address is selected from 
the registered list of mail addresses. If the desired mail 
address has not been registered, the mail address is 
newly registered and selected, or the mail address is 

40 input directly. 

[0099] If the desired mail address is selected from the 
list of the previously registered mail addresses, a profile 
selecting dialog 240, shown for example in Fig.8, is dis- 
played on the mail window 230, and the desired mail 

45 address is selected on the profile selecting dialog 240. 
On the profile selecting dialog 240, there are arranged 
a list display area 241 , which is a list of addresses in the 
form of, for example, a pull-down menu, an OK button 
242 for selecting one of the addresses displayed in the 

50 list display area 241 and a cancel button 243 for termi- 
nating the display of the profile selecting dialog. Al- 
though the addresses demonstrated as the pull-down 
menu of the address list can be the mail addresses per 
se, it is also possible to use a more intelligible profile 

55 name arbitrarily selected by the user from one mail ad- 
dress to another, in the instance of Fig.8, the profile 
name is [aaaa(J)] in which [aaaa] is the user name of 
the reception terminal and [J] indicates that the recep- 
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tion terminal of the destination is a portable telephone 
set (J terminal) of a company J as a portable telephone 
servicing company. Of course, this profile name can be 
set arbitrarily. 

[01 00] If, as the desired destination (profile name) has 
been selected in the list display area 241 , the OK button 
242 is clicked on the profile selecting dialog 240 of Fig. 
8, the CPU 51 causes a profile setting confirmation di- 
alog 250, shown in Fig. 9, in accordance with the E-mail 
program. 

[0101] In the profile setting confirmation dialog 250, 
there are arranged a profile name selected by the user 
in the profile selecting dialog 240, a mail address corre- 
sponding to the profile name, an item display area 251 
demonstrating the mail address of the destination, an 
OK button 252 pushed by the user when the contents 
demonstrated in the display area 251 are correct, a cor- 
rection button 253 pushed by the user when it is desired 
to correct the contents demonstrated in the display area 
251 , and a cancel button 254 for the user to command 
cancelling the display on the dialog 250. Meanwhile, Fig. 
9 shows an instance in which [aaaa(J)], as the profile 
name and the profile name corresponding to the previ- 
ously input comment, [XXXX.YY.ZZ] as the mail server 
name, [eeee. @ffff.gg.hh] as the mail address of the 
destination, [eeee] as the name of the source and [aaaa 
@bbbb.cc.dd] as the mail address of the destination, 
are demonstrated in the display area 251 . 
[01 02] if, on the profile setting confirmation dialog 250 
of Fig. 9, the correction button 253 is clicked by a user, 
the CPU 51 changes the profile setting confirmation di- 
alog to a dialog 260 shown in Fig. 10 in the E-mail pro- 
gram. 

[0103] In the profile setting confirmation dialog 260, 
each item in an item display area 261 can be changed. 
If, after changing a desired one of the items in the item 
display area 261 , an end button 263 is clicked, the item 
of the changed contents is finalized. In the profile setting 
confirmation dialog 260, there are also arranged a re- 
version button 262 for the user to command reversion 
to the status of Fig. 9, a cancel button 264 for the user 
to command cancelling the display on the dialog 260 
and a help button 265 pushed by the user when it is de- 
sired to know the contents displayed on the dialog, 
[01 04] Reverting to Fig.7, when the designation of the 
destination address at step S11 has come to a close, 
the CPU 51 proceeds to the next step S12, in accord- 
ance with the E-mail program. At step S12, the CPU 51 
checks, in accordance with the E-mail program, whether 
or not the reception terminal of the destination specified 
at step S11 is matched to the E-mail having attached 
the image file thereto. The processing of step S12 will 
be explained subsequently in detail. When the decision 
processing at step S1 2 comes to a close, the processing 
of the E-mail program proceeds to the next step S1 3. 
[0105] At step S13, the CPU 51 creates an image file 
for transmission, based on various variables n Image- 
Format, nimageMaxWidth, nlmageMaxHeight, nlmage- 
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MaxSize and nlmageMaxColor, as set by the decision 
processing at step S12, in accordance with the E-mail 
program and with the capture program.. In the variables 
nlmageFormat, the sort of the image format is set, 

5 whereas, in the variables nimageMaxWidth and nlma- 
geMaxHeight, the width and the maximum size of the 
image are set, respectively. In the nlmageMaxSize and 
nlmageMaxColor, the maximum file size and the maxi- 
mum number of colors are set, respectively. 

10 [0106] it is noted that the sort of the image format as 
set in the variable nlmageFormat means the sort of the 
image format that can be received by the reception ter- 
minal when the reception terminal is able to handle the 
E-mail having the image file attached thereto, or the sort 

15 of the image format that can be received by e.g., a per- 
sonal computer owned by the user of the reception ter- 
minal through a serverthat can be accessed by the user 
(WWW server), when the reception terminal is such a 
terminal that is unable to handle the E-mail having the 

20 image file attached thereto, as will be explained in detail 
subsequently by referring to Fig. 12. The width and the 
maximum size of the image set with the variable nima- 
geMaxWidth and nlmageMaxHeight mean the width 
and the maximum size of the image that can be received 

25 and demonstrated by the reception terminal when the 
reception terminal is such a terminal that is able to han- 
dle the E-mail having the image file attached thereto, or 
the width and the maximum size of the image that can 
be received and demonstrated by e.g., a personal com- 

30 puter owned by the user of the reception terminal 
through a server accessible for the user when the re- 
ception terminal is such a terminal that is unable to han- 
dle the E-mail having the. image file attached thereto. 
The maximum file size of the image as set as the vari- 

35 able nlmageMaxSize means the maximum file size of 
the image that can be received and demonstrated by 
the reception terminal when the reception terminal is 
such a terminal that is able to handle the E-mail having 
the image file attached thereto, or the maximum file size 

40 of the image that can be received and demonstrated by 
the reception terminal through a server accessible for 
the user when the reception terminal is such a terminal 
that is unable to handle the E-mail having the image file 
attached thereto Similarly, the maximum number of 

^5 colors of the image as set as the variable nlmageMax- 
Color means the maximum number of colors of the im- 
age that can be received and demonstrated by the re- 
ception terminal when the reception terminal is such a 
terminal that is able to handle the E-mail having the im- 

50 age file attached thereto, or the maximum number of 
colors of the image that can be received and demon- 
strated by the reception terminal through a server ac- 
cessible for the user when the reception terminal is such 
a terminal that is unable to handle the E-mail having the 

55 image file attached thereto. The processing for creating 
this image file for transmission will be explained in detail 
subsequently. 

[0107] When the creation of the image file for trans- 
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mission at step S13 has come to a close, the CPU 51 
proceeds to the next step S1 4 in accordance with the 
E-mail program. At step S14, the CPU 51 refers to a 
variable blmageMain, explained subsequently with ref- 
erence to Fig. 12, in accordance with the E-mail pro- 
gram, to check for whether or not the reception terminal 
is able to receive the E-mail having attached the image 
file thereto. If it is decided at this step S14 that the re- 
ception terminal is able to receive the E-mail, having at- 
tached the image file thereto, that is that the variable 
blmageMain, explained subsequently, is TRUE and 
YES, the CPU 51 proceeds to the processing at step 
S15. If it is decided at this step S14 that the reception 
terminal is unable to receive such E-mail, that is that the 
variable blmageMain, explained subsequently, is 
FALSE and NO, the CPU 51 proceeds to the processing 
at step S17. 

[0108] If, at step S14, the CPU finds that the reception 
terminal is able to receive the E-mail, having attached 
the image file thereto, and proceeds to the processing 
at step S1 5, the CPU creates an E-mail, having attached 
the image file thereto, from the image file for transmis- 
sion, formed based on the variable nlmageMaxSize and 
the above-mentioned comment, in accordance with the 
E-mail program. Meanwhile, the maximum size of the 
E-mail that can be received by the reception terminal is 
set in the variable nlmageMaxSize. 
[0109] The CPU 51 then sends the E-mail, having at- 
tached the image file thereto, at step S1 6, to an address 
specified at the previous step S11, in accordance with 
the E-mail program, to terminate the mail transmission 
processing of Fig. 7. Meanwhile, an instance of a dialog 
280 at the time of mail transmission at step S1 6 is shown 
in Fig. 11 . On the transmission dialog 280, there are ar- 
rayed a progress state display area 281 for demonstrat- 
ing the state of progress at the time of mail transmission 
and a cancel button 282 for the user to command can- 
celling the mail transmission. 

[01 10] If the CPU 51 verifies at step S14 that the re- 
ception terminal is unable to receive the E-mail, having 
attached the image file thereto and thus proceeds to the 
processing of step S1 7, the CPU creates e.g.. an HTML 
(hypertext markup language) file, with an image file at- 
tached thereto, from the image file for transmission and 
the comment, based on variable nHTMLMaxSize, in ac- 
cordance with the E-mail program. In the variable 
nHTMLMaxSize, the maximum size of the HTML file that 
can be received and displayed by a personal computer 
owned by the user of the reception terminal in question 
is set. On completion of the creation of this HTML file, 
the CPU 51 proceeds to the processing of the next step 
S18 in accordance with the E-mail program. 
[0111] AtthisstepS18,theCPU51 creates a mail for 
notification in accordance with the E-mail program. In 
this notification mail, the HTML file is uploaded. Moreo- 
ver, there are written in this mail the URL address of the 
server accessible for the user of the reception terminal 
and the guide. On completion of the creation of this no- 



tification mail, the CPU 51 proceeds to the processing 
of the next step S19 in accordance with the E-mail pro- 
gram. 

[0112] At this step S19, the CPU 51 uploads the 
5 HTML file, prepared at step S1 7, to a server accessible 
for a user having a reception terminal, in accordance 
with the E-mail program. When the uploading at step 
S1 9 comes to a close, the CPU 51 sends the notification 
mail to the reception terminal of the address specified 
10 at step S11 . The CPU 51 then terminates the mail trans- 
mitting processing of Fig. 7. 

[0113] Meanwhile, the processing from step S17 to 
step S20 is such a processing of previously uploading 
the HTML file with the image file in a server, in case the 

15 reception terminal is inherently unable to cope with im- 
age display, as described above, and of automatically 
inserting a URL for viewing the image file into the main 
text of the E-mail, that is the above-mentioned notifica- 
tion mail, to transmit the resulting mail to the reception 

20 terminal. This enables the user of the reception terminal 
to view the image of the HTML file uploaded to the serv- 
er, using the equipment allowing the user to view the 
image file, such as a personal computer. 
[01 14] The detailed flow of the decision processing at 

25 the reception terminal at step S12 of Fig. 7 is shown in 
Fig. 12. 

[0115] At stepS12of Fig.7, the CPU 51 first initializes 
the above-mentioned variables used for saving the re- 
sults of decision, as processing at this step S31 of Fig. 

30 12, in accordance with the E-mail program. The CPU 
then acquires the mail address of the reception terminal 
of the address specified by the user, by way of perform- 
ing the processing at step S32, and then acquires the 
aforementioned supplementary information pertinent to 

35 the address, by way of performing the processing at this 
step S33. After this step S33, the CPU 51 proceeds to 
step S34. 

[0116] At step S34, the CPU 51 verifies, in accord- 
ance with the E-mail program, whether or not the recep- 
tion terminal accommodates (that is, is able to handle) 
the E-mail, having the image file attached thereto, using 
the acquired supplementary information as necessary. 
If, at this step S34, the reception terminal is found to 
accommodate the E-mail, having the image file attached 
45 thereto (YES), the CPU proceeds to the processing of 
step S35 and, if otherwise (NO), the CPU transfers to 
the processing of step S37. 

[0117] If, at step S34, the CPU verifies that the recep- 
tion terminal accommodates the E-mail, having the im- 

50 age file attached thereto, and hence transfers to the 
processing of step S35, the CPU 51 sets the variable 
blmageMail to TRUE in accordance with the E-mail pro- 
gram. Then , at step S36, the CPU verifies the maximum 
mail size that can be received, and that can be handled 

55 by the reception terminal, to set the result in the variable 
nMailMaxSize, After the processing of step S36, the 
CPU proceeds to the processing of step S39. 
[0118] If, at step S34, the CPU 51 finds that the re- 
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ceptlon terminal is unable to accommodate the E-mail, 
having the image file attached thereto, and proceeds to 
processing at step S37, the CPU sets the variable bim- 
ageMaii to FALSE, in accordance with the E-mail pro- 
gram. Then, at step S38, the CPU 51 verifies the max- 
imum file size of the HTML file that can be handled by 
e.g., a personal computer owned by the user of the re- 
ception terminal, through a server accessible for the us- 
er of the reception terminal, and sets the result in the 
variable nHTMLMaxSize. After this step S38, the CPU 
transfers to processing at step S39. 
[0119] If the reception terminal is able to accommo- 
date the E-mail, having the image file attached thereto, 
the C PU 51 at step S39 checks the condition of an image 
that can be handled by the reception terminal, or the 
condition of an image that can be accommodated by e. 
g., a personal computer owned by a user of the recep- 
tion terminal, through a server accessible for the user, 
in accordance with the E-mail program, and sets the var- 
iables nlmageFormat, nlmageMaxWidth, nlmageMax- 
Height, nlmageMaxSize and nlmageMaxColor, based 
on the verified result. That is, at step S39, the CPU 51 
sets, based on the verified result as to the condition of 
the image that can be handled by the reception terminal, 
or the verified result as to the condition of the image that 
can be handled by e.g., a personal computer owned by 
the user of the reception terminal, the sort of the image 
format, as the aforementioned variable nlmageFormat, 
and the maximum width and height of the image as the 
aforementioned nlmageMaxWidth and nlmageMax- 
H eight, respectively. The CPU also sets the maximum 
file size of the image as the variable nlmageMaxSize, 
while setting the maximum number of colors of the im- 
age as the variable nlmageMaxColor. 
[0120] AfterthisstepS39,theCPU51 finishes the de- 
cision processing for the reception terminal to transfer 
to processing at step S13 of Fig. 7. 
[0121] Although the explanation here is directed to 
only the size of the E-mail or the HTML file size, as the 
condition for reception by the aforementioned reception 
terminal or by e.g., the personal computer owned by the 
user of the reception terminal , this is merely for the sake 
of explanation, such that any suitable new conditions 
may also be added as appropriate. 
[0122] Fig. 13 shows detailed flow of processing for 
creation of an image for transmission at step S1 3 of Fig. 
7. 

[0123] At step S13 of Fig .7, the CPU 51 initializes var- 
iables cSize, nColor and nRatio, by way of processing 
at step S41 of Fig. 13. In the variable cSize, the size of 
an original image, photographed or taken from outside 
by the CCD video camera 1 02, or the maximum image 
size that can be received and displayed by the reception 
terminal or by e.g., a personal computer owned by the 
user of the reception terminal, whichever is smaller, is 
set. In the variable nColor, the number of colors of the 
original image photographed or taken from outside by 
the CCD video camera 1 02, or the maximum number of 
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colors that can be received and displayed by the recep- 
tion terminal or by e.g., a personal computer owned by 
the user of the reception terminal, whichever is smaller, 
is set. In the variable nRatio, a default value of the image 

5 compression ratio is set. 

[0124] The CPU 51 then converts the size of the orig- 
inal image, photographed or taken from outside by the 
CCD video camera 102, in keeping with the variable 
cSize, set as described above, by way of processing at 

10 step S42, in accordance with the E-mail program. The 
CPU 51 also converts the number of colors of the orig- 
inal image, photographed or taken from outside by the 
CCD video camera 102, in keeping with the variable 
nColor, set as described above. 

15 [0125] The CPU 51 then compresses the image, the 
image size and the number of colors of which have been 
changed as described above, with the compression ra- 
tio equal to the as-set variable nRatio, by way of the 
processing at step S43, in accordance with the E-mail 

20 program, and transiently saves the compressed image 
as a file of the desired image format that can be received 
by the reception terminal or by e.g., a personal computer 
owned by a user of the reception terminal. The image 
format will be explained in detail subsequently. 

25 [0126] The CPU 51 then verifies, at step 544, whether 
or not the image file of the image format, created as de- 
scribed above, is smallerthan the maximum file size that 
can be received by the reception terminal or by e.g. a 
personal computer owned by the user of the reception 

30 terminal, in accordance with the E-mail program. 

[0127] If it is found at this step S44 that the size of the 
image file created is larger than the aforementioned 
maximum file size (NO), the CPU 51 transfers to 
processing at step S45, in accordance with the E-mail 

35 program and with the capture program, to adjust and re- 
set the aforementioned variables cSize, nColor and 
nRatio in the direction of decreasing the image file size. 
The CPU then reverts to processing at step S42. 
[0128] If, at step S44, the size of the imagefile created 

40 js smaller than the aforementioned maximum file size 
(YES), the CPU 51 completes the processing of gener- 
ating the image for transmission, in accordance with the 
E-mail program and with the capture program, to trans- 
fer to processing at step S14 of Fig .7. 

45 [0129] Although the image is stored in a file and proc- 
essed for conversion at step S43, it is also possible to 
save the image in a memory instead of in a file for image 
conversion and to save the image converted to an image 
of the desired size in the file. 

50 [0130] The image format at step S43 is now ex- 
plained. Meanwhile, since a personal computer in gen- 
eral is able to cope with any image format, depending 
on the application installed, the following explanation is 
directed to an image format that can be received and 

55 displayed by a reception terminal, such as a portable 
telephone set, in which limitations are imposed on the 
image format that can be received. 
[0131] Among the image formats that can be dis- 



14 



BNSDOCID: <EP 



1 1 50465A2_I_> 



27 



EP1 150 465 A2 



28 



played by the portable telephone set, there are, for ex- 
ample, GIF, PNG (portable network graphics) format, 
and JPEG format. 

[0132] The GIF (graphics interchange format) is a sort 
of the image file format developed by COMPUSERVE 
INC. as a leading personal computer communication 
undertaker of USA. Recently, the GIF is frequently used 
for a WWW image and accommodates a color/mono- 
chromatic image with 256 colors or less. Because of its 
high compression efficiency, the GIF is utilized as the 
standard form for Internet, as is the JPEG system. The 
GIF is used in the standard GIF format, but also to an 
interlaced GIF system, in which an entire image is pre- 
sented in a mosaic pattern and read-in progressively, a 
GIF animation system in which simple movements can 
be expressed in a caricature magazine page folding 
fashion, and in a transparent GIF format in which the 
background can be transparent by specifying particular 
colors as transparent colors. These sorts of the GIF are 
prescribed in GIF89a formulated in 1989. Although a 
majority of other file formats, such as TIFF, are of ran- 
dom editing, the GIF uses sequential editing, under the 
circumstances that the GIF was originally designed as 
a transmission format for a datastream. Each block of 
the data has a tag to permit contents to be identified. A 
majority of the web document creating application soft- 
ware and a majority of the image editing processing ap- 
plication software accommodate the GIF format. 
[0133] The PNG format was developed by the PNG 
Development Group, as a file to take the place of GIF, 
in view of handling graphic data in a network environ- 
ment, such as internet environment. The engineer who 
developed this format is Thomas Botel of NASA. The 
PNG adopts the LZ77-based algorithm, and performs 
slightly complex scanning, termed Adam7, in compari- 
son with the interlaced display proper to GI F of drawing 
an image by four times of scanning every several lines. 
Thus, more definite details can be sent than is possible 
with GIF with a smaller transfer volume. The Adam 7 is 
such a scanning in which an image is divided into plural 
blocks of 8x8 pixels and in which pixels in each block 
are sequentially sent out in seven installments to draw 
an image. The data supported and handled by the PNG 
format encompasses index colors (1/2/4/8 bits), gray 
scale (1/2/4/8/16 bits) and RGB colors (24, 48 bits), in 
contradistinction from the GIF that can handle only up 
to the 80-bit index color. The PNG also supports alfa 
channel (a masking channel having luminance) and 
gamma correction. Meanwhile, the GIF specifies partic- 
ular colors as the background color for transmission. 
With the PNG, supporting the similar functions, the de- 
gree of transmission can be represented by luminance 
by using the alfa channel for the gray scale and for the 
RGB color. The animation effect, employing plural im- 
ages, termed GIF animation, is not supported, and 
hence another standard termed MNG (multiple-image 
network graphics) is under consideration. Thus, the 
PNG format is higher in compression efficiency than the 



GIF format, and allows for interlacing or transparency of 
color and for handling of 24-bit color images. The PNG 
format is recommended by W3C (World Wide Web Con- 
sortium), which is the group for standardizing the WWW 

5 (World Wide Web), as being one of the graphic formats 
for WWW. The most recent edition of the PNG supports 
main WWW browsers, such as the Netscape navigator 
(trademark) or the Internet Explorer (trademark). The 
PNG may be forecast to be used in near future as a new 

10 image format to take the place of the GIF format a patent 
of an image compression expansion routine for which is 
owned by UNISIS of USA. 

[0134] The JPEG (Joint Photographic Coding Experts 
Group Graphics Interchange Format) is an appellation 

15 of a joint organization of the ISO (International Stand- 
ardization Organization) and ITU-T (International Tele- 
communication Union-Telecommunication Standardi- 
zation Sector). In general, it denotes the compression/ 
expansion system for still images standardized by this 

20 organization. The format is suited to a natural image, 
the gradation of which is changed continuously, and is 
of an extremely compact file size. By varying the com- 
pression ratio, the information volume can be dimin- 
ished to approximately one-tenth to one-hundredth. The 

25 data compression ratio is raised by decimating color da- 
ta by exploiting the properties that the human eye, sen- 
sitive to changes in luminance, is rather insensitive to 
changes in color. So, if an image is compressed once 
in accordance with the JPEG system, an original image 

30 cannot perfectly be restored. Moreover, if the compres- 
sion ratio is raised, deterioration in image quality, such 
as occurrence of block noise, becomes outstanding. 
The majority of the currently available digital cameras 
use this JPEG system for a file format for image record- 

35 jng. 

[0135] The JPEG provides for motion JPEG and pro- 
gressive JPEG. 

[0136] The motion JPEG is such a system in which a 
color still image compressed on the basis of the JPEG 

40 as the international standard for coding the color still im- 
age is continuously reproduced to realize moving image 
display, that is such a system which compresses each 
frame making up a video moving image in accordance 
with the JPEG system for recording and storage. The 

45 motion JPEG is finding application since each image 
frame of the moving images is formed on the basis of a 
still image and hence the image digitization may be per- 
formed more readily than in an encoding system having 
a highly advanced compression algorithm, such as 

50 MPEG (Moving Image Coding Experts Group) taking 
the inter-frame difference, while frame-based process- 
ing in editing may be facilitated. However, the compres- 
sion ratio is not that high and hence a higher transfer 
speed is required or the file capacity of a digital image 

55 tends to be increased. 

[01 37] The progressive J P EG is a storage system for 
image data supported by the Netscape Navigator 2.0 
(trademark) of the WW browser. With this system, an 
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entire Image in a mosaicked pattern is first displayed 
and read-in as focussing proceeds progressively, in 
contradistinction from an image of the conventional 
JPEG format image read in sequentially from an upper 
side in a blind-lowering fashion. Although the time until 
full display is the same, the viewer feels more relaxed 
since the entire image may be seen from the outset. 
[0138] In the currently available E-mail reception ap- 
plication for personal computers, all of the aforemen- 
tioned formats of images can be displayed in a majority 
of cases. This may, however, not be the case with E- 
maii reception terminals other than the personal com- 
puter. That is, in the case of the reception of an E-mail 
by a portable telephone set, as exemplified in the 
present embodiment, the image format used varies from 
one provider to another, such that, for example, a pro- 
vider J may be using only the PNG format, whilst a pro- 
vider N may be using only the GIF format. In addition, 
the file size, maximum number of colors or the maximum 
image size may be variable from one provider to anoth- 
er. For example, the provider J may be using the maxi- 
mum image size of 680 pixels horizontal and 480 pixels 
vertical, and the maximum number of colors of 256, 
whilst the provider M may be using the maximum image 
size of 94 pixels horizontal and 72 pixels vertical, and 
the maximum number of colors of 256. 
[0139] Thus, in the present embodiment, if the image 
is transmitted as an E-mail, the image is converted on 
the transmitting side in keeping with the capability of the 
reception terminal, as described above. In making such 
conversion, if a given image exceeds limitations as to 
the maximum number of colors and the maximum image 
size, the image is converted so as to fall within the lim- 
itation . The image is then converted to a file of the target 
image format, such as the aforementioned PNG format, 
GIF or JPEG. If the file resulting from the conversion is 
of a size exceeding the maximum file size, the number 
of colors following the conversion is made smaller than 
the maximum number of colors. This operation is re- 
peated until the resulting file is smaller than the maxi- 
mum file size. At this time, the compression ratio can be 
set, depending on the image format. In such case, this 
parameter is also varied to control the image file size. 
That is, the operation of adjusting the number of colors, 
image size or the compression ratio following conver- 
sion and of converting the image to a file is repeated to 
generate an image of a target file size. 
[0140] if an E-mail, having an image file attached 
thereto, as described above, is transmitted, the user of 
a reception terminal may directly view an E-mail with the 
image attached thereto. Alternatively, the user may in- 
directly view the E-mail, with the attached image, by 
having reference to the URL in the notification mail. 
[0141] In the above-described embodiment, the E- 
mail sending terminal is a personal computer fitted with 
a camera and an external memory IF (315, 1). Of 
course, the mobile station, such as the portable tele- 
phone set, may also serve as a transmission terminal. 
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In particular, if a portable telephone set fitted with a cam- 
era and an external memory I F 307 serves as a sending 
terminal, an image photographed by the camera of the 
portable telephone set 307 may be sent along with the 
s E-maii to the reception terminal, in which case the mail 
can be sent after converting an image file in agreement 
with the capability of the reception terminal, as de- 
scribed above. 

[0142] Referringto Figs.1 4 to 1 9, a specified structure 

10 of the portable telephone set fitted with a camera and 
an external memory IF 307 is explained. Fig. 14 shows 
an inner structure of the portable telephone set fitted 
with a camera and an external memory IF 307, Fig. 15 
is an overall view showing the side of the collapsible 

15 portable telephone set 307 carrying keys and a display, 
looking from the front side, Fig. 16 is a right-hand side 
view showing the portable telephone set 307 shown in 
Fig.15, and Fig. 17 is an overall view showing the port- 
able telephone set 307 shown in Fig.15 ; in the collapsed 

20 state, looking from the direction indicated by arrow A in 
Fig.1 6. Fig.18 is right-hand side view showing the port- 
able telephone set 307 in the collapsed state shown in 
Fig. 1 7, and Fig. 1 9 is an overall view showing the port- 
able telephone set 307 shown in Fig. 15, in the collapsed 

25 state, looking from the direction indicated by arrow B in 
Fig. 16. 

[0143] The portable telephone set 307, shown in Fig. 
14, includes, as main components, a main controller 
328, an image encoder 325, an image decoder 326, an 

30 image decoder 329, a display controller 326, an internal 
display unit 327, a multiplexer/demultiplexer 332, a ra- 
dio interfacing (IF) unit 324, a speech codec unit 335, a 
video camera 321, a camera interfacing (IF) unit 324, 
an operating input unit 331, a jog dial 333, a jog dial 

35 interfacing (IF) unit 334, an external memory connecting 
terminal 341, and an external memory interfacing (IF) 
unit 339. The portable telephone set 307 also includes 
an antenna 322, an external terminal 342, an external 
terminal IF unit 340, a key unit 330, an interna! memory 

40 338 : a loudspeaker 336 and a microphone 337. Of 
these, the main controller 328, camera IF unit 323, im- 
age encoder 325, operating input unit 331 , jog dial in- 
terfacing (IF) unit 334, internal memory 338, external 
memory interfacing (IF) unit 339, radio interfacing (IF) 

45 unit 324, display controller 326, image decoder 329, 
multiplexer/demultiplexer 332, speech codec unit 335 
and the external terminal IF unit 340 are interconnected 
over a bus. 

[01 44] The main control ler 328 is comprised of a CPU , 
so while the internal memory 338 is made up of a ROM and 
a RAM. The main controller :28 comprehensively con- 
trols various components of the portable telephone set, 
based on the program stored in the ROM, to realize the 
function as the portable telephone set and the afore- 
55 mentioned functions of embodiments of the present in- 
vention. That is, the main controller 328 at least per- 
forms the function similar to that of the E-mail program 
in the personal computer of Fig. 4. 
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[0145] The video camera 321 is enclosed in the port- 
able telephone set 307 and sends photographed image 
data to the camera IF unit 323. Meanwhile, the video 
camera 321 may be removably mounted on the portable 
telephone set 307. 

[01 46] The camera IF unit 323 sends image data fur- 
nished from the video camera 321 to the image encoder 
325, external memory interfacing (IF) unit 339, external 
terminal IF unit 340 or to the display controller 326. 
[0147] The display controller 326, fed with the image 
data from the camera IF unit 323, controls the interna! 
display unit 327 for displaying an image indicated by the 
image data. 

[0148] The interna! display unit 327 uses e.g., a color 
LCD and has sufficient resolution to display the JPEG 
still image or the MPEG moving image. For example, 
the internal display unit 327 has a sufficient number of 
pixels (1 80x 144) to display e.g., QCIF signals. This in- 
ternal display unit 327 displays an image under control 
by the display controller 326. 

[0149] The image encoder 325, fed with image data 
from the camera IF unit 323, encodes the image data in 
accordance with the JPEG system or the MPEG system, 
such as MPEG4 system, and sends the encoded image 
data to the multiplexer/demultiplexer 332, external 
memory interfacing (IF) unit 339, external terminal IF 
unit 340 or to the image decoder 329. 
[0150] The external memory connecting terminal 341 
is a terminal connected to the external memory housed 
in the stick-, card- or stamp-like casing. The external 
memory interfacing (IF) unit 339 exchanged various da- 
ta between it and the external memory connected to the 
external memory connecting terminal 341 . That is, the 
external memory interfacing (IF) unit 339 operates un- 
der control by the main controller 328 to write image data 
fed from the camera IF unit 323, encoded image data 
fed from the image encoder 325, image data decoded 
by the image decoder 329, data received by the radio 
(IF) unit 324 and speech data encoded or decoded by 
the speech codec unit 335, in the external memory. The 
external memory interfacing (IF) unit 339 operates un- 
der control by the main controller 328 to send unencod- 
ed image data read out from the external memory to the 
display controller 326, to send the read-out encoded im- 
age data to the image decoder 329 and to send read- 
out speech data to the speech codec unit 335. 
[0151] The external terminal 342 is a terminal con- 
nected directly or through a cord to an external equip- 
ment. The externa! terminal IF unit 340 exchanges var- 
ious data between it and the external equipment con- 
nected to the external terminal 342. That is, the external 
terminal IF unit 340 operates under control by the main 
controller 328 to send image data supplied from the 
camera IF unit 323 from the external terminal 342 to the 
external equipment, and to send encoded image data 
supplied from the image encoder 325, encoded image 
data supplied from the image encoder 325, image data 
decoded by the image decoder 329, data received by 



the radio interfacing (IF) unit 324 and speech data en- 
coded or decoded by the speech codec unit 335, to the 
external equipment. The external terminal IF unit 340 
operates under control by the main controller 328 to 

s send unencoded image data fed thereto from the exter- 
na! memory to the display controller 326, to send the 
encoded image data as fed thereto to the image decoder 
329 and to send read-out speech data to the speech 
codec unit 335. 

io [0152] The image decoder 329 decodes compressed 
encoded image data to send the reproduced image data 
to the display controller 326. 

[0153] The display controller 326 controls the internal 
display unit 327 to display an image represented by the 
15 image data supplied from the camera IF unit 323 or from 
the image decoder 329. 

[0154] The internal display unit 327 uses e.g., a color 
CD and has sufficient resolution to display the JPEG still 
image or the MPEG moving image. For example, the 
20 internal display unit 327 has a sufficient number of pixels 
(180x144) to display e.g., QCJF signals. This internal 
display unit 327 displays an image under control by the 
display controller 326. 

[0155] The multiplexer/demultiplexer 332 includes 

25 three operating modes, namely an image speech com- 
munication mode, a speech communication mode and 
a communication mode, and operates under a mode 
specifying by the main controller 328. 
[0156] In the image speech communication mode, the 

30 multiplexer/demultiplexer 332 multiplexes encoded im- 
age data, photographed by the video camera 321 and 
encoded by the image encoder 325, encoded speech 
data supplied from the speech codec unit 335, and other 
data supplied from the main controller 328, in accord- 

35 ance with a pre-set multiplexing system, such as H.221 
of ITU-T recommendations H.223 of the ITU-T recom- 
mendations, or modifications thereof, and routes result- 
ing multiplexed transmission data to the radio interfac- 
ing (IF) unit 324. In the image speech communication 

40 mode, the multiplexer/demultiplexer 332 also demulti- 
plexes the transmission data supplied from the radio in- 
terfacing (IF) unit 324 into encoded image data, encod- 
ed speech data and other data to route the respective 
data to the image decoder 329, speech codec unit 335 

45 and to the main controller 328. 

[0157] In the image speech communication mode, the 
multiplexer/demultiplexer 332 directly sends the encod- 
ed speech data from the speech codec unit 335 through 
he radio interfacing (IF) unit 324 to the antenna 322. 

so Moreover, in the image speech communication mode, 
the multiplexer/demultiplexer 332 directly sends trans- 
mission data (encoded speech data) fed from the radio 
interfacing (IF) unit 324 over the antenna 322 to the 
speech codec unit 335. 

55 [0158] In the data communication mode, the multi- 
plexer/demultiplexer 332 sends transmission data sup- 
plied from the main controller 328 to the radio interfacing 
(IF) unit 324 to send the data to a counterpart terminal. 
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The multiplexer/demultiplexer 332 also is able to receive 
transmission data sent from the counterpart terminal 
through the radio interfacing (IF) unit 324. 
[0159] The speech codec unit 335 has two operating 
modes, that is the image speech communication mode 
and the speech communication mode, and operates un- 
der the mode specified by the main controller 328. In the 
image speech communication mode, the speech codec 
unit 335 digitizes speech signals from the microphone 
337, while encoding the speech signals in accordance 
with a pre-set low-rate speech encoding system, such 
as G729 of the ITU-T recommendations, to produce en- 
coded speech data, which is sent to the multiplexer/de- 
multiplexer 332. In the image speech communication 
mode, the speech codec unit 335 decodes the ADPCM 
codes in the encoded speech data supplied from the 
multiplexer/demultiplexer 332, while converting the de- 
coded data into analog signals to produce speech sig- 
nals which are routed to the loudspeaker 336. 
[0160] In the speech call mode, the speech codec unit 
335 digitizes speech signals from the microphone 337, 
while encoding the digitized signal in accordance with, 
for example, the ADPCM system (G721 of the ITU-T 
recommendations) to produce encoded speech data, 
which encoded speech data are sent to the multiplexer/ 
demultiplexer 332. In the speech call mode, the speech 
codec unit 335 decodes the ADPCM codes in the en- 
coded speech data supplied from the multiplexer/de- 
multiplexer 332 and converts the decoded data to pro- 
duce speech signals, which speech signals are sent to 
the loudspeaker 336. 

[0161] On receipt of an operating signal from the key 
unit 330, made up of operating devices, such as plural 
key switches, the operating input unit 331 notifies com- 
mand signals thereof to the main controller 328. 
[0162] The jog dial 333 has functions substantially 
similarto those of the jog dial 4 provided on the personal 
computer shown in Fig. 1 and generates signals corre- 
sponding to rotation and push operations. The jog dial 
interfacing (IF) unit 334 sends an operating signal from 
the jog dial 333 to the main controller 328. 
[0163] Referring to Figs. 15 to 19, the portable tele- 
phone set 307, fitted with the camera and the external 
memory IF, includes an upper casing 354, carrying the 
antenna 322, display 327 and the loudspeaker 336, and 
a lower casing 356, carrying the key unit 330, jog dial 
333, an external memory insertion/ejection opening 350 
and the microphone 337. The upper and lower casings 
354, 356 are interconnected by e.g., a hinge 352, by 
means of which the upper and lower casings 354, 356 
can be collapsed in the direction indicated by arrow C 
at a longitudinal mid portion of the device. 
[0164] The upper casing 354 is provided with a cam- 
era arraying portion 353 rotatably fuicrumed in the di- 
rection indicated by arrow D. This camera arraying por- 
tion 353 is provided with the video camera 321 . at least 
one lens 357 and with a CCD. The portable telephone 
set of the present embodiment, in which the lens 357 of 



the video camera is fitted on the rotatably fuicrumed 
camera arraying portion 353, has an improved degree 
of freedom in the photographing direction. 
[0165] The external memory insertion/ejection open- 

5 ing 350, provided on the lower casing 356, is designed 
so that the external memory, such as the stick-shaped 
external memory, can be introduced therein. A button 
351 is an ejection button thrust when ejecting the exter- 
nal memory inserted into the external memory insertion/ 

10 ejection opening 350. 

[0166] In the present embodiment, described above, 
if, in sending an E-mail with a file attached thereto, and 
opening or viewing the attached file in the reception ter- 
minal, the contents of the attached file can be displayed 

15 in the reception terminal irrespective of the file format of 
the attached file to the transmitted E-mail, the image 
size or the maximum number of colors in displaying the 
file contents. 

[0167] In the present embodiment the contents of the 
20 attached file can be confirmed by the user on the recep- 
tion terminal. Embodiments of the present invention 
may however be applied to such a case in which, if the 
. format itself of the main text of the E-mail is not accom- 
modated by the reception terminal, the format of the E- 
25 mail is to be converted to a format accommodated by 
the reception terminal. 

[0168] The present embodiment is directed to the ca- 
pability of the reception terminal itself. However, embod- 
iments of the present invention may also be applied to 
30 such a case in which e.g., the file is to be converted in 
meeting with the capability of the entire system encom- 
passing the reception terminal. 

[0169] The medium used for installing the program for 
executing the above-described sequence of operations 

35 on a computer for execution by the computer includes 
not only package mediums, such as floppy disc, CD- 
ROMs or DVDs, but also a semiconductor memory or a 
magnetic disc in which the program is stored transiently 
or perpetually. The medium used for installing the pro- 

40 gram may also be implemented by wired or radio com- 
munication mediums, such as local area network, Inter- 
net or digital satellite broadcast or a variety of commu- 
nication interfaces, such as routers or modems used for 
transferring or receiving the program furnished by these 

45 communication mediums. The medium used for install- 
ing the program is, therefore, to be construed broadly to 
encompass all of these mediums. 
[0170] Hence, in embodiments of the present inven- 
tion in transmitting/receiving an E-mail with a file at- 

50 tached to it, the contents of the attached file is to be dis- 
played in a reception terminal irrespective of the file for- 
mat of a file attached to the E-mail, the image size or 
the maximum number of colors in displaying the file con- 
tents. To this end, the accommodating capability in a re- 

55 ception terminal is verified at step S12 based on a mail 
address in sending an E-mail with an attached file to a 
reception terminal at step S11 . If the accommodating ca- 
pability in the reception terminal is not matched to the 
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attached file, the file is converted at steps S15, S17 in 
keeping with the accommodating capability of the recep- 
tion terminal, and the E-mail is sent at steps S 1 6 and 
S 1 8 to S20 with the so-converted file attached to it. 
[0171] In so far as the embodiments of the invention 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 
appreciated that a computer program providing such 
software control and a storage medium by which such 
a computer program is stored are envisaged as aspects 
of the present invention. 

[0172] Although particular embodiments have been 
described herein, it will be appreciated that the invention 
is not limited thereto and that many modifications and 
additions thereto may be made within the scope of the 
invention. For example, various combinations of the fea- 
tures of the following dependent claims can be made 
with the features of the independent claims without de- 
parting from the scope of the present invention. 

Claims 

1. An information processing apparatus for transmit- 
ting the information to be transferred to a reception 
terminal, comprising: 

accommodating capability verifying means for 
verifying the information accommodating capa- 
bility in said reception terminal or in a commu- 
nication system encompassing said reception 
terminal, based on the destination information 
in sending the transfer information to said re- 
ception terminal; 

information converting means for converting 
the transfer information to be transmitted in 
meeting with the information accommodating 
capability in said reception terminal or in said 
communication system encompassing said re- 
ception terminal if the information accommo- 
dating capability in said reception terminal or in 
said communication system encompassing 
said reception terminal is not matched to said 
transfer information to be transmitted; and 
transmission means for transmitting said trans- 
fer information. 

2. The information processing apparatus according to 
claim 1 wherein the E-mail information is sent as 
said transfer information to said reception terminal. 

3. The information processing apparatus according to 
claim 2 wherein said accommodating capability ver- 
ifying means verifies the information accommodat- 
ing capability of said reception terminal based on a 
domain name of an E-mail address as said destina- 
tion information and/or on a previously provided in- 
formation accommodating capability table of a re- 



ception terminal or a system encompassing said re- 
ception terminal. 

4. The information processing apparatus according to 
s claim 2 wherein, if said reception terminal or said 

communication system encompassing said recep- 
tion terminal is not matched to the file information, 
said information converting means generates the E- 
mail information stating a method enabling a user 
i o of said reception termi nai to conf irm t he co ntents of 

said file information; 

said transmission means sending said E-mail. 

5. The information processing apparatus according to 
15 claim 4 wherein, if said reception terminal or said 

communication system encompassing said recep- 
tion terminal is not matched to the file information, 
said information converting means states the ac- 
cessing information to means for saving said file in- 
20 formation in said E-mail as a method enabling the 
confirmation of the contents of said file information. 

6. The information processing apparatus according to 
claim 2 wherein the file information attached to said 

25 E-mail is an image file. 

7. The information processing apparatus according to 
claim 2 wherein the information accommodating ca- 
pability of said reception terminal or said communi- 

30 cation system encompassing said reception termi- 
nal includes the maximum size of the E-mail, the 
format of the information of the attached file and the 
maximum file size of the file information. 

35 8. The information processing apparatus according to 
claim 6 wherein the information accommodating ca- 
pability of said reception terminal or said communi- 
cation system encompassing said reception termi- 
nal includes the maximum size of the E-mail, the 

40 image format of the attached image file, the maxi- 

mum file size of the image file, the maximum pixel 
size of the image corresponding to said image file, 
and the maximum number of colors of the image 
corresponding to said image file. 

45 

9. The information processing apparatus according to 
claim 6 wherein, if said image file is a moving image 
file and the information accommodating capability 
of said reception terminal or said communication 

so system encompassing said reception terminal cor- 
responds only to a still image file, said information 
converting means renders one or plural frames 
making up said moving image file into the file infor- 
mation attached to said E-mail. 

55 

10. An information processing method for transmitting 
the information to be transferred to a reception ter- 
minal, comprising: 
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verifying the information accommodating capa- 
bility in a reception terminal or in a communica- 
tion system encompassing said reception ter- 
minal, based on the destination information in 
sending the transfer information to said recep- 5 
tion terminal; 

converting the transfer information to be trans- 
mitted in meeting with the information accom- 
modating capability in said reception terminal 
or in said communication system encompass- 10 
ing said reception terminal if the information ac- 
commodating capability in said reception termi- 
nal or in said communication system encom- 
passing said reception terminal is not matched 
to said transfer information to be transmitted; 15 
and 

transmitting said transfer information. 

11. The information processing method according to 
claim 1 0 wherein the E-mail information not having 20 
a file attached thereto is sent as said transfer infor- 
mation to said reception terminal. 

12. The information processing method according to 
claim 11 wherein said accommodating capability 25 
decision decides the information accommodating 
capability of each reception terminal based on a do- 
main name of an E-mail address as said destination 
information and/or a previously provided table of in- 
formation accommodating capabilities of reception 30 
terminals or a communication system encompass- 
ing said reception terminals. 

13. The information processing method according to 
claim 11 wherein, if said reception terminal or the 35 
communication system encompassing said recep- 
tion terminal is not matched to the file information, 
there is generated the E-mail information stating a 
method enabling an owner of said reception termi- 
nal to confirm the contents of said file information 40 
to be confirmed, and the resulting E-mail is trans- 
mitted. 

14. The information processing method according to 
claim 13 wherein, if said reception terminal or the 45 
communication system encompassing said recep- 
tion terminal is not matched to the file information, 

the accessing information to saving means for sav- 
ing said file information is stated in said E-mail as 
the method enabling the contents of said file infor- so 
mation to be confirmed. 

15. The information processing method according to 
claim 11 wherein the file information attached to 
said E-mail is an image file. 55 

16. The information processing method according to 
claim 11 wherein the information accommodating 



capability of said reception terminal or the commu- 
nication system encompassing said reception ter- 
minal includes the maximum size of an E-mail, the 
format of said attached file information and the max- 
imum file size of said file information. 

17. The information processing method according to 
claim 15 wherein the information accommodating 
capability of said reception terminal or the commu- 
nication system encompassing said reception ter- 
minal includes the maximum size of an. E-mail, the 
image format of said attached image file, the max- 
imum file size of said imagefile, maximum pixel size 
of an image matched to said image file and the max- 
imum number of colors of an image corresponding 
to said image file. 

18. The information processing method according to 
claim 15 wherein, if the imagefile is a moving image 
file and the information accommodating capability 
of said reception terminal or the communication 
system encompassing said reception terminal is 
matched only to a still image file, one frame only or 
plural frames making up said moving image file is 
rendered into the file information attached to said 
E-mail. ■ 

19. An information processing system comprising: 

one or more reception terminals and 
one or more transmission terminals; 
said transmission terminal sending the transfer 
information to a desired reception terminal in- . 
eluding accommodating capability verifying 
means for verifying the information accommo- 
dating capability in said reception terminal or in 
a communication system encompassing said 
reception terminal, based on the destination in- 
formation in sending the transfer information to 
said reception terminal, information converting 
means for converting the transfer information 
to be transmitted in meeting with the informa- 
tion accommodating capability in said reception 
terminal or in said communication system en- 
compassing said reception terminal If the infor- 
mation accommodating capability in said re- 
ception terminal or in said communication sys- 
tem encompassing said reception terminal is 
not matched to sajd transfer information to be 
transmitted, and transmission means fortrans- 
mitting said transfer information; 
said reception terminal including reception 
means for receiving said transfer information 
sent from said transmission terminal and infor- 
mation opening means for opening the transfer 
in received. 

20. The information processing system according to 
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claim 1 9 wherein the E-mail information not having 
a file attached thereto is sent as said transfer infor- 
mation to said reception terminal. 

21. The information processing system according to 
claim 20 wherein said accommodating capability 
decision means decides the information accommo- 
dating capability of each reception terminal based 
on a domain name of an E-mail address as said 
destination information and/or a previously provid- 
ed table of information accommodating capabilities 
of reception terminals or a communication system 
encompassing said reception terminals. 

22. The information processing system according to 
claim 20 wherein, if said reception terminal or the 
communication system encompassing said recep- 
tion terminal is not matched to the file information, 
said information terminal generates the E-mail in- 
formation stating a system enabling an owner of 
said reception terminal to confirm the contents of 
said file information to be confirmed, and the result- 
ing E-mail is transmitted by said transmission 
means. 

23. The information processing system according to 
claim 22 wherein, if said reception terminal or the 
communication system encompassing said recep- 
tion terminal is not matched to the file information, 
said information converting means of said transmis- 
sion terminal states the accessing information to 
saving means for saving said file information in said 
E-mail as the method enabling the contents of said 
file information to be confirmed. 

24. The information processing system according to 
claim 20. wherein the file information attached to 
said E-mail is an image file. 

25. The information processing system according to 
claim 20 wherein the information accommodating 
capability of said reception terminal or the commu- 
nication system encompassing said reception ter- 
minal includes the maximum size of an E-mail, the 
format of said attached file information and the max- 
imum file size of said file information. 

26. The information processing system according to 
claim 24 wherein the information accommodating 
capability of said reception terminal or the commu- 
nication system encompassing said reception ter- 
minal includes the maximum size of an E-mail, the 
image format ofsaid attached image file, the max- 
imum file size of said image file, maximum pixel size 
of an image matched to said image file and the max- 
imum number of colors of an image corresponding 
to said image file. 



40 

27. The information processing system according to 
claim 24 wherein, if the imagefile is a moving image 
file and the information accommodating capability 
of said reception terminal or the communication 

5 system encompassing said reception terminal is 
matched only to a still image file, said information 
converting means of said transmission terminal 
renders one frame only or plural frames making up 
said moving image file into the file information at- 

10 tached to said E-mail. 

28. An information processing method comprising: 

verifying the information accommodating capa- 
15 biiity in said reception terminal or in a commu- 

nication system encompassing said reception 
terminal based on the destination information 
in transmitting the transfer information to said 
reception terminal; 
20 converting the transfer information to be trans- 

mitted in meeting with the information accom- 
modating capability in said reception terminal 
or in said communication system encompass- 
ing said reception terminal if the information ac- 
25 commodating capability in said reception termi- 

nal or in said communication system encom- 
passing said reception terminal is not matched 
to said transfer information to be transmitted; 
transmitting said transfer information; 
30 receiving said transfer information transmitted; 

and 

opening .the transfer information received. 

29. The information processing method according to 
35 claim 28 wherein the E-mail information not having 

a file attached thereto is sent as said transfer infor- 
mation to said reception terminal, 

30. The information processing method according to 
*o claim 29 wherein said accommodating capability 

decision decides the information accommodating 
capability of each reception terminal based on ado- 
main name of an E-mail address as said destination 
information and/or a previously provided table of in- 
45 formation accommodating capabilities of reception 
terminals or a communication system encompass- 
ing said reception, terminals. 

31. The information processing method according to 
50 claim 29 wherein, if said reception terminal or the 

communication system encompassing said recep- 
tion terminal is not matched to the file information, 
the E-mail information stating a method enabling an 
owner of said reception terminal to confirm the con- 
55 tents of said file information is generated; 

said E-mail is sent; 

the E-maii transmitted is received; and 
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a method for enabling confirmation of the con- 
tents of said file information stated in the E-mail 
received is executed. 

32. The information processing method according to 5 
claim 29 wherein, if said reception terminal or the 
communication system encompassing said recep- 
tion terminal is not matched to the file information, 
the accessing information to saving means for sav- 
ing said file information is stated in said E-mail as 10 
a method enabling confirmation of the contents of 
said file information; 

said E-mail is transmitted; 

the E-mail transmitted is received; and '5 
said saving means is accessed based on the 
accessing information stated in the E-mail re- 
ceived. 

33. The information processing method according to 20 
claim 29 wherein the file information attached to 
said E-mail is an image file. 

34. The information processing method according to 
claim 29 wherein the information accommodating 2s 
capability of said reception terminal or the commu- 
nication system encompassing said reception ter- 
minal includes the maximum size of an E-mail, the 
format of said attached file information and the max- 
imum file size of said file information. 30 

35. The information processing method according to 
claim 33 wherein the information accommodating 
capability of said reception terminal or the commu- 
nication system encompassing said reception ter- 35 
minal includes the maximum size of an E-mail, the 
image format of said attached image file, the max- 
imum file size of said image file, maximum pixel size 

of an image matched to said image file and the max- 
imum number of colors of an image corresponding *o 
to said image file. 

36. The information processing method according to 
claim 33 wherein , if the image file is a moving image 

file and the information accommodating capability 45 
of said reception terminal or the communication 
system encompassing said reception terminal is 
matched only to a still image file, one frame only or 
plural frames making up said moving image file are 
rendered into the file information attached to said so 
E-mail. 



tion terminal based on the destination informa- 
tion in sending the transfer information to a re- 
ception terminal; 

a step of converting the transfer information 
transmitted in keeping with the information ac- 
commodating capability in said reception termi- 
nal or a communication system encompassing 
said reception terminal if the information ac- 
commodating capability in said a reception ter- 
minal or the communication system encom- 
passing said reception terminal is not matched 
to said transfer information transmitted; and 
a step of sending said transfer information. 

38. A medium for causing an information processing 
apparatus to execute a program comprising: 

a step of verifying the information accommodat- 
ing capability in a reception terminal or a com- 
munication system encompassing said recep- 
tion terminal based on the destination informa- 
tion in sending the transfer information to a re- 
ception terminal; 

a step of converting the transfer information 
transmitted in keeping with the information ac- 
commodating capability in said reception termi- 
nal or a communication system encompassing 
said reception terminal if the information ac- 
commodating capability in said a reception ter- 
minal or the communication system encom- 
passing said reception terminal is not matched 
to said transfer information transmitted; 
a step of sending said transfer information; 
a step of receiving the transfer information 
transmitted; and 

opening the transfer information received. 



10 



15 



37. A medium for causing an information processing 
apparatus to execute a program comprising: 

a step of verifying the information accommodat- 
ing capability in a reception terminal or a com- 
munication system encompassing said recep- 
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